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PREFACE 


This book has been written as a part of my program of teaching at the 
graduate level. The primary aim of the book is to assist graduate stu- 
dents in learning fundamental ideas and theorems about linear spaces 
and linear operators and to lead them to an appreciation of the unifying 
power of the abstract-linear-space point of view in surveying the prob- 
lems of algebra, classical analysis, the theory of integration, and differen- 
tial and integral equations. While the book is principally addressed to 
graduate students, it is also intended to be useful to mathematicians, both 
pure and applied, who have need of a simple and direct presentation of 
the fundamentals of the theory of linear spaces and linear operators. 

The central theme of the book is the theory of normed linear spaces 
and of linear operators which map one such space into another. A 
normed linear space which is complete is called a Banach space; a num- 
ber of the most important results in linear-space theory depend on com- 
pleteness, and so we have a Banach space context for these results. 
However, the hypothesis of completeness is not invoked except as it is 
needed for effective results. The more specialized theory of inner-prod- 
uct spaces (which, when complete and infinite dimensional are called 
Hilbert spaces) is carried along within the normed-linear-space context, 
leaning upon the general theory of normed linear spaces, but with its own 


viii PREFACE 


characteristic special development where such development can achieve 
results of a distinctive character. 

Although the emphasis is mainly on normed linear spaces, the more 
general ideas of topological linear spaces are developed to some extent, 
since an understanding of these is relevant at many places in the theory 
of normed linear spaces, notably in connection with the weak topologies 
of such spaces and their conjugate spaces. Part of Chapter 3 provides 
a brief introduction to the study of general topological linear spaces, 
both without and with the assumption of local convexity. The geom- 
etry of convex sets and linear varieties (especially hyperplanes) is all 
presented in the context of topological linear spaces. 

There are many illustrations and applications of the abstract concepts 
and methods. The numerous problems serve both to illustrate and to 
extend the theory, as well as to train the student by having him fill in 
details omitted in the text. For many of the illustrations and problems 
the sequence spaces P have been chosen, in order to minimize the 
technical analytical difficulties. There are applications to differential 
equations, to integral equations, and to the classical theory of analytic 
functions. 

Chapter 5 stresses the importance of complex contour integration and 
the calculus of residues in the spectral theory of linear operators. The 
methods apply to all closed linear operators, bounded or not. This 
chapter also contains the famous Riesz theory of compact (completely 
continuous) operators, as extended and perfected by later research 
workers, and its application to obtain the classical “determinant-free” 
theorems for Fredholm integral equations of the second kind. 

Chapter 6 presents the standard elementary theory of self-adjoint, 
normal, and unitary operators in Hilbert space. There is also the dis- 
cussion, very important for applications to integral and differential equa- 
tions, of the theory of compact symmetric operators and symmetric 
operators with compact resolvent. This discussion does not require the 
completeness of the inner-product space under consideration. The 
spectral analysis of self-adjoint operators is performed with the aid of 
the Riesz representation theorem for linear functionals on a space of 
continuous functions. The treatment is deliberately kept as close to 
classical analysis as possible within this framework. After the student 
is acquainted with the situation from this point of view, he may with 
great profit go on to a study of B*-algebras, and learn to view the spec- 
tral theorem for a normal or self-adjoint operator as a consequence of 
the Gelfand-Neumark theorem for commutative B*-algebras. For an 
understanding of these developments Chapter 7 is an essential prepara- 
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tion. But there is no room in this book for a treatment of Banach al- 
gebras. 

The book is an introduction, not a treatise. It is meant to open doors 
for the student and to give him understanding and preparation which will 
help him to push on, if he wishes, to the new frontiers of modern math- 
ematics, carrying with him a clearer realization of the structure of clas- 
sical mathematics. 


ANGUS E. TAYLOR 
Los Angeles 


August 1957 
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INTRODUCTION 


It is the purpose of this introduction to explain certain notations and 
terminologies used throughout the book. 


Sets 


Let X be a given set. If x is an element of X this fact is expressed in 

symbols by writing 
x e X. 

The negation of x € X is written in the form 
x é X. 

A subset of X is a set E such that if x € E, then also xe X. In particu- 
lar, X is a subset of itself. A subset of X which is not all of X is called 
a proper subset of X. The statement '* E is a subset of X” is expressed in 
symbols by writing 

Ec X, or X E. 
Two sets E, F are the same if and only if E c Fand FC E. 
Among the subsets of a given set is the empty set, the set having no 


elements. We denote the empty set by 0. 
l 
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Let X be a set and let x be a variable element of X. For each x let 
P(x) denote a proposition concerning x. Then we use the symbol 


{x :P(x)} 
to denote the set of all x € X for which P(x) is true. This notation is 
extended in an obvious manner for more than one proposition. Thus, if 
P(x), P(x), --- are propositions, (x:P,(x), n=1, 2, - - -) denotes the set 
of all x € X such that P,(x) is true for each of the values n = 1, 2, -- -. 


Example I. Let X be the set of all continuous real-valued functions of 
s on the interval O < s < 1. Let E be the subset of X consisting of those 
functions x for which x(0) = x(1). Then 


E = (x:x(0) = x(1)). 
Example 2. Let X be the set of all real-valued functions x which are 
defined and have derivatives of all orders for all real values of s. Let E 


be the set of those x such that x and all its derivatives have the value 0 at 
s=Q. Then 


E = {x:x 0) = 0, n=0,1,2,---}. 


Subsets of a given set can be combined in two ways: by the formation 
of unions and intersections. If E, «++, E, are subsets of Y, the union of 
E, +++, E, is defined as the set of all elements of X which belong to at 
least one of the sets E,,---, E,. This union is denoted by 


EUEU U Ep or UE. 
i=1 


This definition and notation are extended to arbitrary collections of 
subsets of X as follows: Suppose @ is a collection (family) of subsets of X. 
The set of all x € X such that x € E for at least one E € € is denoted by 


E 
Eeg 


and is called the union of the sets of €. In case & is a countable set, with 
members £,, Ez, -+ +, we write the union as 
x 
U E,. 
n=! 


If the members of & are indexed in some manner, say E,, where « ranges 
over a set A, we may denote the union by 


U Ej 
acA 
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The intersection of a collection € of subsets E of X is defined as the set 
of all x € X such that x € E for every Ee €. It is denoted by 


Nz 
Eeó 


If the members of @ are indexed, the intersection is represented symbolic- 
ally in the appropriate manner corresponding to the usage for unions, but 


with 

() in place of $. 
The intersection of the finite collection Ej, ---, E, is also written in the 
form 


E Cy E098 ES 


If E € X, the complement of E (relative to X) is defined as the set of 
all x € X such that x € E. We denote the complement of E by E’, or, in 
some cases where the prime notation is inconvenient, by C(E). Observe 
the following: 

(E) = E, 
and if E C F, then F' c E*. 

There is an important relation between complements, unions, and 
intersections; namely: If & is a collection of subsets of X, the complement 
of the union of all the members of & is the intersection of their comple- 


ments. That is, 
Chea 


Eeg Eeó 
For a finite collection this can be written 
(EU EU- U Ey = BY OEY n OE. 


If we replace E; by E;' throughout and then take the complement of both 
sides, we obtain the equivalent relation 


(E,;N E,0-+-O£,) = EU EU. U Er. 
The general form of this is 
IDs ES 
Ees Eeg 


If E and F are subsets of X, the difference E — F is defined as the set of 
all x € X which are in E but not in F. In other words, 


E-F=EQF". 
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Functions 


In this book, unless we make special mention to the contrary, we always 
use the word “function” to mean a single-valued function. Since we shall 
have a great deal to do with functions whose arguments and values need 
not be real or complex numbers but may be elements of quite arbitrary 
sets, we put down here explicitly our general definition of a function. 

Let X and Y be arbitrary nonempty sets. Suppose there is some rule 
whereby to each element x € X corresponds a uniquely determined element 
y€Y. Consider the set consisting of all ordered pairs (x, y), where 
x € X and y is the corresponding element of Y. This set of pairs is called 
a function. The set X is called the domain of the function. The set of 
y's which occur as correspondents of the x's may or may not comprise all 
of Y. In any event, this set of y's is called the range of the function. 

We see by this definition that a function with domain X and range 
contained in the set Y is a subset of the set of a// ordered pairs (x, y) with 
xeX and y e Y. This latter set of all such pairs is denoted by X x Y 
and called the Cartesian product (or often, just the product) of X and Y. 
Thus, a function with domain X and range in Y is a particular kind of 
subset of X x Y. The distinguishing property of a function, as contrasted 
with other subsets of X x Y, is that among the pairs (x, y) which form the 
distinct elements of the function, each x in X occurs once and only once. 
Any subset of X x Y with this property is a function with domain X and 
range in Y. Thus, let F be a subset of X x Y. Then F is a function 
with domain X and range in Y if and only if the two following conditions 
are satisfied: 


1. To each x € X corresponds some y € Y such that (x, y) € F, 
2. If (xi, y1) and (xz, y;) are in F and y, 7 y», then x; # x2. 


Sometimes we have occasion to consider nonempty sets X, Y and a 
function whose domain is a proper subset of X and whose range is con- 
tained in Y. In this case the function is a subset of X x Y which satisfies 
the second but not the first of the two foregoing conditions. 

If F is a function and (x, y) € F, we write y = F(x): this is the usual 
functional notation. In general, we find it best to refer to the function 
by the single letter F, reserving the notation F(x) for the element of the 
range of F which corresponds to the element x of the domain. Sometimes, 
however, it is convenient to do otherwise. Thus, in speaking of the 
exponential function, we may refer to the function e*, or the function 
y = e*, instead of using the lengthy phraseology “‘the function consisting 
of all pairs (x, y), where y — e* and x varies over all real numbers." 
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Inverse Funct fons 


Suppose Fis a function with domain D and range R, where D — X and 
Rc Y. Consider the Cartesian product Y x X; note the reversal of 
order. Consider the subset of Y x X consisting of those elements (y, x) 
such that (x, y) € F. It may be that this subset of Y x X is a function 
(with domain in Y and range in X). If so, we call it the function inverse 
to F, and we often denote it by F-!. The domain of F^! is then R, and 
its range is D. 

Observe that. the inverse of F is defined if and only if the correspondence 
between x and F(x), as x varies over D, is a one-to-one correspondence 
between the elements of D and the elements of R. Another way of 
putting it is that F has an inverse if and only if F(x,) = F(x2) implies that 
Xp = X2. 

Also observe that, when F has an inverse, y — F(x) is equivalent to 
x = F-Wy) Finally, if F has the inverse F-', then F~' also has an 
inverse, namely F. 


Usage Relating to Real Numbers 


The least upper bound (if it exists) of a set S of real numbers is denoted 
by sup S. The greatest lower bound of S is denoted by inf S.. The sup 
and inf notation is also used in other appropriate situations. For instance, 
if f is a real-valued function whose domain includes the set E, the least 
upper bound of the set of all f(x) corresponding to x in E is denoted by 


sup f(x). 
xeE 


We follow standard usage with respect to the symbols + œ, — oo in 
relation to the real number system. 


Inequalities 


At a number of places in this book we use some of the standard 
inequalities concerning sums and integrals. We list the most commonly 
used ones here. The standard reference work on this subject is the book, 
Inequalities, by Hardy, Littlewood, and Pólya. In what follows we refer 
to this book as H, L, and P, and cite by number the section in which the 
stated inequality is discussed. In all inequalities the quantities involved 
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may be either real or complex. Sums are either all from 1 to n or from 
1 to œ, and in the latter case certain evident assumptions and implications 
of convergence are involved. For simplicity the inequalities for integrals 
are written for the case in which the functions are defined on a finite or 
infinite interval of the real axis. The inequalities are valid with more 
general interpretations of the set over which integration is extended. 

Hólder's inequality for sums (H, L. and P, 82.8): If 1 < p < œ and 
p= oy then 


2|aibi| < Cla: 0 [b;]r)vm. 


The special case when p — p' — 2 is called Cauchy's inequahty (H, L, 
and P, § 2.4). 

Minkowski's inequality for sums (H, L, and P, $2.11): If 1 € p < oo, 
then 


(Dla; + bit < (dla)? + (Èb; |P). 
Jensen's inequality (H, L, and P, $2.10): If 0 < p < q, then 
(Zla;|))!/* < C ja;|»)vr. 
Hólder's inequality for integrals (H, L. and P. $6.9): If 1 < p < oo 


ra, 
and p TES then 


foo 8(x)| dx < (JII ax) dx) k (fisol dx". 


The special case when p — p' — 2 is called the Schwarz inequality (H, L, 
and P, $ 6.5). 

Minkowski's inequality for integrals (H, L, and P, $6.13): 
] € p « œ, then 


(ffo + (x) dx)” < (fIr? ax)” + (figo dx)” 


The Kronecker Delta 


The symbol 3;; denotes the number | if i = j and the number 0 if 
i * j. Here i and j are positive integers. 


THE ABSTRACT APPROACH 
TO: 
LINEAR PROBLEMS 


1.0 Introductory Statement 


The modern treatment of many topics in pure and applied mathematics 
is characterized by the effort which is made to strip away nonessential 
details and to show clearly the fundamental assumptions and the structure 
of the reasoning. This effort often leads to a certain degree of abstraction, 
the concrete nature of the originally contemplated problem being tempor- 
arily put.aside, and the aspects of the problem which are of greatest 
significance being cast into axiomatic form. It is found that in this way 
there is a considerable gain in transparency and that diverse problems 
exhibit common characteristics which enable them all to be at least partially 
solved by the methods of a single general theory. 

In this chapter we consider the algebraic aspects of such an abstract 
approach to linear problems. In essence, all linear problems are viewed 
in some measure as analogous to the linear problems exhibited in elemen- 
tary algebra by the theory of systems of linear equations. The linear 
problems of analysis usually require topological as well as algebraic 
considerations. However, in this chapter, we exclude all concern with 
topology; the topological aspects of the abstract approach to linear prob- 
lems will be taken up in later chapters. 
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The profoundest results of the chapter are the extension theorems in 
§ 1.71 (Theorems 1.71-A and 1.71-D). They depend on Zorn’s lemma. 
Theorem 1.71-A is needed to demonstrate the existence of certain 
projections (see Theorem 4.8-A). Theorem 1.71-D is the fundamental 
tool in proofs concerning the extension of continuous linear functionals 
and, in particular, in the proof of the Hahn-Banach theorem (see Theorems 
3.7-B, 3.8-D, and 4.3-A). 

Chapter 1 culminates in $ 1.91 with two groups of theorems: one group 
(the first three theorems) concerning the range of a linear operator and 
the null manifold of the transpose of the operator and the other group 
(the last four theorems) concerning the null manifold of the operator and 
the range of its transpose. These theorems furnish information on 
existence and uniqueness theorems in the case of certain kinds of linear 
problems. For the finite-dimensional case these theorems include the 
standard results concerning algebraic systems of linear systems. In the 
infinite-dimensional case the results are not as useful as results which can 
be obtained with the aid of metric or topological tools. Nevertheless, 
the material of $1.91 points the way to more incisive results, some of 
which are given in $ 4.6. 


l.i Abstract Linear Spaces 


We have as yet made no formal definition of what is meant by the 
adjective linear in the phrase “‘linear problems." We can cite various 
particular kinds of linear problems: the problems of homogeneous and 
inhomogeneous systems of linear equations in n "unknowns" in ele- 
mentary algebra; the problems of the theory of linear ordinary differential 
equations (existence theorems, particular and general solutions, problems 
of finding solutions satisfying given conditions at one or two end points); 
boundary or initial-value problems in the theory of linear partial differ- 
ential equations; problems in the theory of linear integral equations; 
linear “transform” problems, e.g., problems related to Fourier and 
Laplace transforms. This is by no means an exhaustive list of the types 
of mathematical situation in which linear problems arise. 

At.the bottom of every linear problem is a mathematical structure 
called a linear space. We shall therefore begin with an axiomatic treat- 
ment of abstract linear spaces. 

A collection of elements, together with a certain structure of relations 
between elements or of rules of manipulation and combination, the whole 
supporting a mathematical development, is often called a space. This 
terminology derives from the model of geometry, in which the elements 
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are points. We are now going to define what is meant, abstractly, by a 
linear space. 


Definition. Let X be a set of elements, hereafter sometimes called 
points, and denoted by small italic letters: x, y, +--+. We assume that 
each pair of elements x, y can be combined by a process called addition 
to yield another element z denoted by z = x + y. We also assume that 
each real number « and each element x can be combined by a process 
called multiplication to yield another element y denoted by y — «x. The 
set X with these two processes is called a /inear space if the following 
axioms are satisfied: 


Lx+y=y+x. 

2. x+(y+z)=(x+y) +z. 

3. There is in X a unique element, denoted by 0 and called the zero 
element, such that x + 0 = x for each x. 

4. To each x in X corresponds a unique element, denoted by — x, 
such that x + (— x) = 0. 

5. a(x + y) = ax + ay. 

6. (a + B)x = ax + Bx. 

7. a(Bx) = (aB)x. 

8. I. x 2 x. 

9. 0.x «0. 


Anyone who is familiar with the algebra of vectors in ordinary three- 
dimensional Euclidean space will see at once that the set of all such 
vectors forms a linear space. An abstract linear space embodies so many 
of the features of ordinary vector algebra that the word vector has been 
taken over into a more general context. A linear space is often called a 
vector space, and the elements of the space are called vectors. 

In the foregoing list of axioms it was assumed that the multiplication 
operation was performed with rea/ numbers «, 8. To emphasize this, if 
necessary, we call the space a real linear space, or a real vector space. 
An alternative notion of a linear space is obtained if it is assumed that 
any complex number « and any element x can be multiplied, yielding 
another element «x. The axioms are the same as before. The space is 

The notion of a vector space is defined even more generally in abstract 
algebra, by allowing the multipliers «œ, B, - - - to be elements of an arbitrary 
commutative field. In this book, however, we confine ourselves to the 
two fields of real and complex numbers, respectively. The elements of 
the field are called scalars, to contrast with the vector elements of the 
linear space. 
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It is easy to see that — 1:x = — x and that «.0 — 0. We write 
x — y for convenience in place of x + (— y). The following “‘cancel- 
lation" rules are also easily deduced from the axioms: 


(1.1-1) x + y = x + z implies y = z; 
(1.1-2) ax = ay and a z 0 imply x = y; 
l (1.1-3) «x = Bx and x + 0 imply « = f. 


With respect to addition, a linear space X is an Abelian (commutative) 
group, in the technical algebraic sense. 


Definition. A nonempty subset M of a linear space X is called a 
linear manifold in X if x -- y is in M whenever x and y are both in M 
and if also ax is in M whenever x is in M and « is any scalar. 


In this definition and generally throughout the book, statements made 
about linear spaces, without qualification as to whether the space is real 
or complex. will be intended to apply equally to real spaces and complex 
spaces. 

It will be seen at once that, if M is a linear manifold in X, it may be 
regarded as a linear space by itself. For, if x isin M, then — 1-.x = — x 
is also in M, and x — x = 0 is also in M. The nine axioms for a linear 
space are now found to be satisfied in M. Another term for a linear 
manifold in X is subspace of X. A subspace of X is called proper if it is 
not all of X. 

The set consisting of 0 alone is a subspace. We denote it by (0). 

Suppose S is any nonempty subset of X. Consider the set M of all 
finite linear combinations of elements of S, i.e., elements of the form 
aX, 0 +++ + a,X,, where n is any positive integer (not fixed), xi, ---, x, 
are any elements of S, and o,,---, e, are any scalars. This set M 
is a linear manifold. It is called the linear manifold generated, or 
determined, by S. Sometimes we speak of M as the linear manifold 
spanned by S. It is easy to verify the truth of the following statements: 
(1) M consists of those vectors which belong to every linear manifold 
which contains S; i.e., M is the intersection of all such manifolds. (2) M 
is the smallest linear manifold which contains S; ie., if N is a linear 
manifold which contains S, then M is contained in N. 

One of the most important concepts in a vector space is that of linear 
dependence. 


Definition. A finite set of vectors xj, > © +, x, in the space X is linearly 
dependent if there exist scalars «oj, ---, «,, not all zero, such that 
aX, cocco eX, — 0. If the finite set xi. ++, x, is not linearly 
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dependent, it is called /inearly independent. In that case, a relation 
ox, +++: d oux, = 0 implies that a, = -< =e, =0. An infinite set 
S of vectors is called linearly independent if every finite subset of S is 
linearly independent; otherwise S is called linearly dependent. 


Observe that, if a set of vectors contains a linearly dependent subset, 
the whole set is linearly dependent. Also note that a linearly independent 
set cannot contain the vector 0. 

We note the following simple but important theorem, of which use will 
be made in later arguments: 


Theorem I.I-A. Suppose xj, +++, X, is a set of vectors with x, # 0. 
The set is linearly dependent if and only if some one of the vectors x», +--+, 
Xn» SAY Xy, is in the linear manifold generated by x, +++, xy-4. 


PROOF. Suppose the set is linearly dependent. There is a smallest 
integer k, with 2 < k < n, such that the set xj, ---, x, is linearly 
dependent. This dependence is expressed by an equation «jx; +--+ + 
a,X, = 0, with not all the «’s equal to zero. Necessarily, then, a, # 0, 
for otherwise x4, - - -, x, , would form a linearly dependent set. Conse- 
quently x, = ixi. + +++ + B,-1x;-,, where B; = — ejfe,. This shows 
that x, is in the manifold spanned by xj, +--+, x,-,. On the other hand, 
if we assume that some x, is in the linear manifold spanned by x, ---, 
X,-1, then an equation of the form x, = fiX +--+ + By-1X4-, shows 
that the set x,, +--+, x, is linearly dependent, whence the same is true of the 
set X1, °°, Xp. 

It is convenient to say that x is a linear combination of x1, - - +, x, if it 
is in the linear manifold spanned by these vectors. 

Using the notion of linear dependence, we can define the concept of a 
finite-dimensional vector space. 


Definition. Let X be a vector space. Suppose there is some positive 
integer n such that X contains a set of n vectors which are linearly inde- 
pendent, while every set of n + 1 vectors in X is linearly dependent. 
Then X is called finite dimensional, and n is called the dimension of X. 
A vector space with just one element (which must then be the zero element) 
is also called finite dimensional, of dimension zero. If X is not finite 
dimensional, it is called infinite dimensional. 


As we shall see later, the spaces of greatest interest in analysis are 
infinite dimensional. Nevertheless, it will often be of use to consider 
finite-dimensional spaces. Such spaces are, moreover, the source of 
much of our intuitive perception about what to expect in dealing with 
linear spaces generally. 
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Definition. A finite set S in a space X is called a basis of X if S is 
linearly independent and if the linear manifold generated by S is all of X. 


If x1, -- -, x, is a basis of X, the definition means that every x in X can 
be expressed in the form x = éx] +-+ + £x, Since the basis is a 
linearly independent set, the coefficients é, - - -, £, are uniquely determined 


by x; that is, x cannot be expressed as a different linear combination of the 
basis elements. 

It is readily seen that, if X is n-dimensional, where n > 1, then X has 
a basis consisting of n elements. For, X certainly contains vectors x4, 
<., x, which form a linearly independent set. Now, for any x, the set 
of n + 1 vectors xj, X5, +++, x,, x must be linearly dependent, by the 
definition of the dimensionality of X. Hence it is clear, by Theorem 
1.1-A, that x is in the linear manifold spanned by x,,---, Xp This shows 
that xj, - - -, x, form a basis of X. 

Next we wish to show that if X has a basis of n elements, then X is 
n-dimensional. First we prove a lemma. 


Lemma l.1-B. Jf the finite set x, - - +, x, generates X, and if yi, + +>, 
Ym are elements of X forming a linearly independent set, then m < n. 


PROOF. If S is any linearly dependent finite ordered set of vectors uw, 
+++, Up with u; # 0, let S’ denote the ordered set which remains after the 
deletion of the first u; which is a linear combination of its predecessors. 
Also, for any y, let yS denote the ordered set (y, 4, © + +, up). Now define 
Sı to be the set (Ym, X1,°° X4), S2 = ya 1$), S3 = Ym-257', and so on. 
We make several observations: (1) S, spans X, is a linearly dependent 
set, and ym # 0. Hence we can form S,' (see Theorem 1.1-A). (2) S,' 
and hence also S}, spans X. We can continue in this way, constructing 
new sets S and S' as long as the y's last. Since the set of y's is linearly 
independent, the discarded element at each step must be an x. Since we 
can form S;',---, S,/, it follows that we discard m x's. and hence n 2 m, 
as asserted in the lemma. 


Theorem l.I-C. [f the linear space X has a basis of n elements, X is 
n-dimensional, and conversely. 


PROOF. The proof of the converse has already been given (just before 
Lemma 1.1-B). If X has a basis of n elements, any linearly independent 
set in X has at most n elements, by Lemma 1.1-B. On the other hand, 
the basis is a set of n linearly independent elements. Hence X is 
n-dimensional, by definition. 

The following theorem will be useful later on: 


Theorem l.I-D. Let X be an n-dimensional vector space, and let the 
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set Yı, °**; Ym be linearly independent, with m < n. Then there exists a 
basis of X composed of yi, +++; Ym and n — m other vectors. 


PROOF. Let x;, ---, x, be a basis of X. Let S, be the ordered set 
(Jp rs Ym Xp ccs X), and let S; = Sj, S4 = Sy’, and so on, where 
S’ is related to S in the manner explained in the proof of Lemma 1.1-B. 
Observe that S; is certainly linearly dependent and that the deleted vector 
at each step is one of the x's (by Theorem 1.1-A), so that each S; includes 
Yis cc Ym Since S, spans X, so does S,’, and so on. We can form 
Sg if and only if S, is linearly dependent. Ultimately we reach a stage 
where S, is linearly independent and spans X. It is then a basis of X 
and includes y;,---, Ym Since the basis must have n elements, there are 
n — m vectors in addition to y1, * * :, Ys 

It is natural to expect that, if X is a linear space of dimension n, every 
subspace of X has dimension not exceeding n. This is indeed the case. 


Theorem l.I-E. Suppose the vector space X is of dimension n, and let 
M be a proper subspace of X. Then M is of some finite dimension m, where 
m « n. 


PROOF. If M = (0), it is of dimension 0, by definition. Since X must 
contain nonzero elements, n > 0, so the assertion of the theorem is true 
in this case. We now assume that M contains nonzero elements. If x 
is a nonzero element of M, it forms a linearly independent set in M. On 
the other hand, a linearly independent set in M cannot contain as many as 
n elements. For, a linearly independent set of n elements is a basis of X 
(as we saw following the definition of a basis), so that, in such a case X 
would be generated by M; this is impossible, since M X, and the linear 
manifold generated by the manifold M is M itself. We now consider 
the nonempty class of all linearly independent sets in M. Each such set 
has a finite number of elements p, where 1 < p « n. There is therefore 
a set for which p is largest, say p = m. It is immediate that m < n 
and that M is of dimension m. 

Before going on to consider the general form of linear problems in 

.linear spaces, we illustrate to some extent the great variety of possible 
examples of linear spaces. 


1.2 Examples of Linear Spaces 


Example I. The simplest important example of a real linear space is 
the set of all n-tuples of real numbers, x = (£j, ---, é). The definitions 
' of addition and multiplication by scalars in this space are as follows: 


If x= (&, ++, é,) and y = (qi, ---, 7,), then z = x + y, where 
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z=(0,-°5 Go) bk =& +m kb +++, n. The vector ax is (£s, 

<- o£). Here the é’s, 7’s, and « are arbitrary real numbers, and n is 
an arbitrary, fixed positive integer. We define 0 = (0, ---, 0) and 
—x=(- é, —&). It is an easy matter to verify that the nine 
axioms for a linear space are satisfied. 

The dimension of this space is n; we prove this by exhibiting a basis 
consisting of n elements. Let e; = (1, 0, ---, 0), e2 = (0, 1, 0,-.., 0), 

+e, = (0,0,---,0, 1). If x = (£, +--+, £j), observe that x = je; + 
--- + ée, Thus, the set ej, ---, e, generates the whole space. More- 


over, the set is linearly independent, for «je; + --- + ee, = (e, °°, 
«,) = 0 if and only if all the o's are zero. Thus ej, ---, e, constitute a 
basis. 


We call this space n-dimensional real arithmetic space, and denote it 
by R,,. 


The space R, has a familiar geometrical interpretation, £,, - - -, £, being 
the coordinates of the point x in a system of Cartesian coordinates. 
Thus, A, is interpreted as a line, R; as a plane, and so on. In the geo- 
metrical interpretation of R, we may regard the element x either as a 
point or as the vector from O (the origin in R,) to that point. For 
geometrical interpretations this latter point of view is in many ways the 
most fruitful. 


Example 2. The set of all n-tuples x = (£i, - -, £,) of complex numbers 
forms a complex linear space, which we call n-dimensional complex 
arithmetic space, and denote by C,,. 

The n vectors e, = (1, 0, ---, 0), ---, e, = (0, ---, 0, 1) form a basis 
of C,. It will be observed that the elements of R, belong to C,; how- 
ever, R, is not a subspace of C,, for, if « is complex and x is in R,, 
then «x is in C, but not always in R, (e.g., i-e; = (i, 0,---, 0) is not 
in R,). 

The set C, can also be regarded as a real linear space, by using the real 
field for scalar multipliers. But then the space is not of dimension n, 
but of dimension 2n, one possible basis consisting of the vectors ei, ++, 
e, and iej, ---, ie,. We shall hereafter always regard C, as a complex 
space. 


Example 3. Let [a, b] (with a < b) be a finite closed interval of the 
real axis, and let x denote a continuous real-valued function whose value 
at the point s of [a, b] is x(s). Let C[a, b] denote the set of all such 
functions, and define x, + xz, «x in the natural manner, i.e., z = x, + x», 
where the value of z at s is z(s) = x,(s) + X2(s); y = ox, where the value 
of y at s is y(s) = ax(s). It is clear that C[a. b] is a real vector space. 
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We might equally well have considered complex-valued continuous 
functions of s; in that case we would have obtained a complex vector 
space. We shall denote this space by C[a, b] also; thus, in speaking of 
the space C[a, b], we shall have to make clear by an explicit statement 
whether we are talking about real-valued or complex-valued functions. 
In either case, C[a,b] is infinite dimensional. For, let x(s) = 1, 
x,(5) = s", n = 1,2,--+. Evidently, xo, X1, +++, X, all belong to C[a, b]. 
This set of elements is linearly independent, no matter how large n is; for, 
by well known properties of polynomials, if «o + es +--+ + œ," = 
for every s such that a < s < b, then « = à 5+: =a, = 0. There- 
fore C[a, b] cannot be finite dimensional. 

The interval [a, b] does not play a very important role in the demonstra- 
tion that C[a, 5] is a vector space and of infinite dimension. For example, 
we could equally well have considered continuous functions of a complex 
variable which ranges over some fixed infinite point set in the complex 
plane. An infinite set is essential to make the space infinite dimensional. 


A great many of the linear spaces which are of interest in analysis are 
spaces whose elements are functions. We shall mention a few further 
examples. 


Example 4. Let f be a function of the complex variable z which is 
defined (single valued), analytic, and bounded in the open unit circle 
|z| < 1. The class of all such functions becomes a complex vector space 
when f + g and of are defined in the natural way. This space is infinite 
dimensional. As a subspace we mention the class of all those functions 
fin the space for which f(0) = 0. Another subspace is the class of those 
f's whose definitions can be extended to the boundary |z| = 1 in such a 
way that each f is continuous in the closed circle |z| < 1. Both of these 
subspaces are infinite dimensional. 


Example 5. Consider the complex-valued functions x of the real 
variable s which are such that x(s), x'(s) and x'(s) are defined and captin- 
uous on the closed interval [0, 7]. The set of all such functions is a 
linear space. It is of interest in considering ordinary second-order linear 
differential equations with coefficients continuous on (O0, 7]. The set of 
all elements of the space which satisfy the equation x'(s) + x(s) = 0 isa 
subspace of dimension 2. A basis of the subspace is furnished by the 
functions eis, e-is, Another basis is furnished by sin s and cos s. Another 
Subspace of interest is that consisting of all elements of the space such 
that x(0) = x(7) = 0. This subspace is infinite dimensional, for it 


contains the infinite linearly independent set consisting of sin ns, n = 1, 
D eds 
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Example 6. As elements of a space consider infinite sequences x = 
{é} (n = 1,2, - - -) such that » |&|? < oo, the é’s being complex numbers. 


n=1 

Define «x = {aé,} and {é} + {m} = {én + »,). It is readily seen (by 
Minkowski’s inequality with p = 2) that this is an infinite-dimensional 
complex linear space. We denote it by /?. It is the space which was 
first extensively studied by D. Hilbert in his work on quadratic forms in 
infinitely many variables, with applications to the theory of integral 
equations. On this account /? is the classical prototype of the variety 
of linear space known today under the name Hilbert space. Hilbert 
spaces are linear spaces with a certain special kind of metrical structure. 
We discuss them extensively elsewhere in this book. 


Example 7. Suppose p > 1 (p not necessarily an integer). Let .Z» 
denote the class of all functions x of the real variable s such that x(s) is 
` defined for all s, with the possible exception of a set of measure zero, and 
is measurable and |x(s)|? is integrable (in the Lebesgue sense) over the 
range (— oo, oo). Instead of (— oo, oo) we could equally well consider 
(0, œ) or any finite interval (a, b). We write £(— œ, oo), £9(0, oo), 
-Z»(a, B) to distinguish these various situations. Also, we usually omit 
the index p when p = 1, writing Z for #1. 

Let 2, denote the set on which x is defined. We define ax as the 
function (ex)(s) = «x(s), with Z,, = Z,, and x + y as the function 
(x + y)(s) = x(s) + p(s), with Z,,, — 2,012, Clearly axe YP if 
x€L?; it is also true that x + pe Y if x, ye Zr. This latter fact 
follows from the inequality 


(1.2-1) |A + Bl» < 2»[|A]» + |Bl»], 


where A and B are any real or complex numbers. For, if w is measurable, 
if z is integrable, and if |w(s)| < |z(x)|, then w is integrable. To see the 
truth of (1.2-1), observe that 


max (|4|, |B|} < [4| + |B| < 2 max (|A]. {Bi}, 


|A + Bl? < (|A| + |B|)? < (2 max ([4[, (Bl)? 
= max (27|A|», 27 B|»?) < 2°|A|P + 27] Ble. 


If we define x = y to mean that 2, = 2, and x(s) = y(s) for every 
s € Z,, we may at first think that £” is a linear space. It is not, however. 
For, if Zr were a linear space, the zero element z would necessarily be the 
function defined for all s, with z(s) — O for every s. But then 
X + (— x) = z would not be true for all x, as we see by choosing an x 
for which Z, does not include every s. To get around this difficulty we 
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proceed as follows: Define an equivalence relation =° in Z7 by saying 
that x =° yif x(s) = y(s) a.e. (i.e., almost everywhere, which means except 
on a set of measure zero). The set of equivalence classes into which # 
is thus divided is denoted by L»; here also, we write L for L!. For the 
time being we shall denote an element of L? which contains x by [x]. 
We define [x] + ly] = [x + y]. This definition of [x] + [y] is un- 
ambiguous, for, if x =° x, and y =° y4, it follows that x; + y; =° x + y. 
Likewise, we define «[x] = [ex], noting that «x =° ax, if x =9x,. With 
these definitions the class L? becomes a linear space; the zero element of 
Lr is the equivalence class consisting of all x € .Z» such that x(s) = 0 ae. 


In practice we usually ignore the notational distinction between £r 
and L? and write x instead of [x]. When we do this it must be remembered 
that x really denotes, not a single function, but a class of equivalent 
functions. 

The space L” is of interest in connection with Fourier transforms and 
various kinds of integral equation problems. The case p — 2 is especially 
important. 

As an example of a subclass of £? that is useful in certain applications 
to first-order ordinary differential equation problems, we mention the 
following: the class of all x for which x(s) is defined everywhere and is 
absolutely continuous on every finite interval and both x(s) and x'(s) 
define elements of 2r. 


Example 8. Let [a, b] be a finite closed interval of the real axis. Let 
BV [a, b] denote the class of real-valued functions of s which are defined 
and of bounded variation on [a, b]. This class is a linear space. 


Example 9. Let x be a complex-valued function of the real variable s 
which is defined and has derivatives of all orders for every value of s. 
The class of all such functions x is evidently a linear space. 


It would be easy to give many more examples of linear spaces whose 
elements are certain kinds of functions. We shall see later on in this 
book that the study of linear spaces leads us to introduce still other linear 
Spaces composed of functions defined on the original linear spaces. 


1.3 Linear Operators 


A linear operator is a certain kind of function whose domain is a linear 
space and whose range is contained in another linear space (possibly the 
same as the first one). For the terminology concerning functions we refer 
the reader to the Introduction. If A is a linear operator, it is customary 
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to omit parentheses and write Ax instead of A(x) whenever it seems 
convenient. 


Definition. Let X and Y be linear spaces (both real or both complex). 
Let A be a function with domain X and range contained in Y. Then A 
is called a linear operator, or more explicitly a linear operator on X into 
Y, if the following two conditions are satisfied: 


(1.3-1) A(x, + x?) = Ax, + Ax), 

(1.3-2) A(ax) = «Ax. 

Here « is an arbitrary scalar, and x, x2, x are arbitrary vectors from X. 
It follows immediately by induction from (1.3-1) and (1.3-2) that 

(1.3-3) Alax + ^ + aux) = ax +--+ + 0,AX,, 

for arbitrary n. Also, by taking « = 0 in (1.3-2), we see that 

(1.3-4) A(0) = 0. 


Sometimes we consider a linear operator A whose domain is a proper 
subset of a given linear space X. The domain is itself a linear space (by 
definition), and so it is a subspace of X. Our standard notation for the 
domain of A is Z(4). We denote the range of A by AA). 


Theorem 1.3-A. Let A be a linear operator with domain D(A) c X 
and range &(A) € Y, where X and Y are linear spaces. Then B(A) is a 
linear manifold in Y. 


PROOF. Suppose y;, y; € (A), and let e be a scalar. We have to prove 
that y, + y; and «y; are in Z(A4). Now y, € &(A) means that there is an 
x1 € Z(A) such that Ax, = yı. Likewise Ax, = y, for some x; E€ WA). 
Then, since A is linear, A(x, + x;) = Ax, + Ax; = y, + yo, and 
A(ax;) = «Ax, = ay,. The desired conclusions are now evident. 

If a linear operator A has an inverse, we denote it by 47!. (The reader 
should consult the Introduction for the definition of the inverse of a 
function.) The statement ‘‘4-! exists" means the same as “A has an 
inverse." 


Theorem 1.3-B. The inverse of a linear operator A exists if and only 
if Ax = 0 implies x = 0. When A`! exists it is a linear operator. 


PROOF. We know by the definition of an inverse function that 4-1! 
exists if and only if Ax, = Ax,implies x; = x2. Suppose Ax = O implies 
x = 0, and let Ax, = Ax. Then, by the linearity of A, A(x; — x2) = 0, 
whence x, — x; = 0, or x, = x) Thus A-! exists. Now suppose, vice 
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versa, that A-! exists, and let x be a vector for which Ax = 0. Then 
A(x) = A(0) [see (1.3-4)], and so, by the condition for the existence of 
A-1,x = 0. This finishes the proof of the first statement in the theorem. 
The proof that 4-1 is linear, when it exists, is left to the reader. 


The linear problems of algebra and analysis are concerned with linear 
operators on various linear spaces. We mention two kinds of problems 
in very general terms: existence problems and uniqueness problems. 
Suppose 4 is a given linear operator, with domain a given space X and 
range in a given space Y. Then we can ask: '*For which elements y € Y 
does there exist in X an element x such that 4x — y?" This is the same 
as asking: “Which elements of Y belong to #(A)?” Existence problems 
are of this kind. 


Example |. Let Y = C[0, 1] (real-valued functions). Let X be the 
subclass of Y consisting of those elements x which have first and second 
derivatives continuous on [0, 1] and which are, moreover, such that 
x(0) — x'(0) 2 0. Let p and q be members of Y, and define 4 on X by 
Ax = -y where 


ys) = x'(s) + p(s)x'(s) + aG)xG). 


Then A is linear on X into Y. Is (A) all of Y? This is the question 
as to whether the differential equation 


x" + px’ +qx=y 


has a solution such that x € X, for each choice of y € Y. Note that x € X 
implies that x(0) = x'(0) = 0. The "initial conditions" have been 
incorporated into the definition of the domain of A. There is a standard 
existence theorem in the theory of differential equations which does in fact 
assure us that Z/(4) = Y. It also assures us that for a given y there is 
.only one x in X such that Ax = y. Therefore A^! exists. 


Example 2. Let X be the space BV[0, 1] defined in Example 8, § 1.2. 
Let Y be the space of all bounded sequences y = (9j) (i = 1, 2, ---) 
where the definitions of the algebraic processes in Y are made as for the 
space /? of Example 6, $ 1.2. Define a linear operator 4 on X into Y 
by Ax — y, where 


1 
US ik sk dx(s). 


The integral here is a Stieltjes integral. The 7,’s are called moments. -A 
Sequence {»,} which arises in this way is called a moment sequence arising 
from x. A moment sequence is certainly bounded, for |n,| cannot exceed 
the total variation of x. But which bounded sequences are moment 
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sequences? That is, how can we recognize those bounded sequences 
which are in the range of 4? This is a classical problem known as the 
moment problem of Hausdorff. In this case Z(A) is not all of Y. Fora 
description of #(A) (i.e., of all moment sequences) we refer the reader to 
Chapter 3 of D. V. Widder, 1; consult the bibliography.* 

In addition to existence problems there are uniqueness problems. In 
the case of any linear operator 4 we can ask: is the x such that Ax = y 
unique in all cases in which a solution for x exists? This is the same as 
the question: does A~! exist? By Theorem 1.3-B this is equivalent to the 
question: does the equation Ax = 0 have a unique solution (namely 
x —0)? To answer this question for a particular operator we must have 
a good deal of detailed knowledge about the operator. 


Example 3. Let Y = C[a, b] and let X be the subspace of C[a, b] 
consisting of those functions x which have continuous first and second 
derivatives on [a, b] and are such that x(a) = x(b) = 0. Define A on X 
into Y by Ax = x", where x" is the second derivative of x. It is easy to 
show that 4-! exists. For, Ax = 0 implies that x(s) = cys + cz, where 
cı and c, are constants, and the requirements x(a) = x(b) = 0, then lead 
to the conclusions c; = c; = 0. It is also easy to show that @(A) = Y. 
For a given y € C[a, b} the unique x in X such that Ax = y is given by 


s u s—a b u 
x(s) = f du | y(t) dt — sl du | y(t) dt. 
With a little manipulation this formula may be put in the form 


b 
xG) = i K(s, Nyt) dt, 


where 
(s — b)t — a) 
b—a 


(6 —a0—5 ley, 
b—a 


K(s, t) = 


Note that K(s, t) = K(t, s) and that K is continuous on the square where 
it is defined. 


Sometimes there is an important connection between existence problems 
and uniqueness problems. This connection is simplest in the case of 
finite-dimensional spaces, as we shall see in Theorem 1.3-E. 


* References to the bibliography are made by listing the author's name and a number 
in boldface type, identifying a book or article by that author. 
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Lemma 1.3-C. Let A be a linear operator on X into Y, and let X be of 
finite dimension n. Then B(A) is of some finite dimension m, with m < n. 

PROOF. If#(A) = (0), then m = 0, and there is nothing more to prove. 
Since X = (0) implies Z(4) = (0), we assume that n > 0 and that 


RA) # (0. Suppose yi, +--+, y,4 are in ZA). Then, there exist 
vectors Xi, ^s, X444 in X with Ax, = yo, k =1,---,a+ 1. Since X is 
of dimension n, there exists scalars œj, * - *, %:41, not all zero, such that 
eX; tet + Oy Xp =O. Then 0 = Alexi b rir oSu4xX41) = 


oy; T ccc + esa Yagi, SO that the set y1, ---, Yn41 iS linearly dependent. 
Now HA) certainly contains some finite linearly independent sets, for a 
single nonzero vector is such a set. Hence, (A) contains a finite linearly 
independent set with the largest possible number of elements, and this 
number m cannot exceed n, as has been shown. This completes the proof. 

Theorem 1.3-D. Jn addition to the hypothesis of Lemma 1.3-C, 
assume that A`! exists. Then @(A) is of the same dimension as X (the 
domain of A). 

PROOF. We know m < n, by the lemma. Now &(A) = Z(A-!) and 
X = &A"'). Hence, applying the lemma to 4^ !, n < m. Thus m = n. 


Theorem 1.3-E.. Let A be a linear operator on X into Y, where X and 
Y are both of the same finite dimension n n. Then R(A) = Y if and only if 
AI exists. 


PROOF. If A~! exists, we know that #(A) is of the same dimension as 
X. It follows by Theorem 1.1—E that 4(4A) cannot be a proper subset of 
Y and must, therefore, coincide with Y. On the other hand, suppose that 
JA) = Y. Let yi, ++, y, bea basis of Y. There exist vectors xj, «++, 
x, in X such that Ax, = y, k = 1, 2,---, n, since Z(A4) = Y. The set 
of x's is linearly independent. For, if «(xq +--+ + «x, = 0, it follows 
that 0 = Alax +--+ + eux) = ayy, occ + ey, whence a, =.. 
= a, = 0, since the set of y's is linearly independent. Consequently, the 


Set x), +--+, x, is a basis of X. Now suppose Ax = 0 for some x. We 
can express x in the form x = a,x, +- + o,x,, and so 0 = Ax = 
ayi + +++ c oy, This implies oj = +> =a, = 0, and so x= 0. 


Therefore A-! exists. The proof is now complete. 

Finite dimensionality is essential in Theorem 1.3-E. We can see that 
this is so by the following example. Let X be the linear space of Example 
9, § 1.2, and let Y = X. Define A by setting Ax = y, where y(s) = x'(s). 
In this case Z(4) = X, for a solution of Ax = y is given by x(s) = 


3 
Í Y(t) dt. The inverse 4-! does not exist, however, for Ax = 0 in the 


case of every constant function. 


22 INTRODUCTION TO FUNCTIONAL ANALYSIS [§ 1.4 


PROBLEM 


Alternative argument for second part of proof of Theorem 1.3-E: Assume 
that #(A) = Y but that A-! does not exist, so that there is an x, # 0 with 
Axı = 0. Choose x2, ---, x, so that x4, : s, x, isa basis of X. Let y, = Ax;, 
k = 2,--+-,n, and show that the whole of Y is generated by yo, : : -, Yp. 


1.4 Linear Operators in Finite Dimensional Spaces 
Let X denote either the real space R, or the complex space C, (Examples 


l and 2, § 1.2). Let Y=R,, if X = R, and Y = C, if X = C, Here 
m and n may be any positive integers. Let 


Oy, 012. `t Aln 

zx 21, 14902272 ves. 0 
(1.4-1) (eue ees r 
Oml m2 Cmn 


be any m x n matrix of scalars (real or complex according as X and Y 
are real or complex). Such a matrix defines a linear operator 4 on X 


into Y as follows: Ax = y, where x = (é, <- &) y = (qois Nm) 
and 
(1.4-2) . ege; =n; i=l, m. 

2 


The linear problems connected with the operator A are, in this case, 
problems connected with the system of m linear equations (1.4-2). The 
special properties of the operator 4 must be found by an examination of 
the particular matrix (1.4-1). 

We recall the notation 


& = (1, 0,--,0,- 6, = (0, +++, 0, 1) 


introduced in Example 1, § 1.2. The vectors ei, ---, e, form a basis of 
X. Let us write 


A = (1,0, ---, 0), -+ Jm = 0, -+ 9, 1) 
for the analogous basis in Y. Observe that x = £ie, +--+ + £e, and 
y—WmfÁct + fm Now let us define vectors aj, ++, a, in Y by 
a, = Ae,. Since € = 3, (the Kronecker delta) if x = e,, we see by 
(1.4-2) that 


a = >> sie - * ejf; = (gs Cons rs Omk) 


i=! 
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In other words, the vector a, appears as the ktt column in the matrix 
(1.4-1). 

—ə In the foregoing situation we started with an arbitrary m x n matrix 
and used it to define a linear operator on X into Y. Let us now proceed 
the other way around. We shall start with an arbitrary linear operator 
A on X into Y and show that there is an m x n matrix of the form 
(1.4-1) such that it defines the operator A, in the sense that Ax = y means 
precisely that the 7’s are defined in terms of the é’s by equations (1.4-2). 

If A is the given operator, we define a; = Ae; j = 1, --, n. The a’s 
are vectors in Y and can, therefore, be expressed in terms of the basis 
fis +++ fm Let the expression of a; be aj = «jfi c s + amm In 
this way we arrive at the set of scalars o;;, with which we form the matrix 
(1.4-1). Now, if x = ($ <, £) and y = Ax = (n, +++, 5,), we have 
to show that the equations (1.4-2) are valid. We have x = je, +--+ + 
£e, Ax = £a, +++ + Endy OF 


j=! i j=) 


i=l i=l 


Since the expression of a vector in terms of the basis is unique, this last 
equation is equivalent to the equations (1.4-2). 

The foregoing considerations show that the study of linear operators 
on R, into R,, is closely related to the study of matrices of the form 
(1.4-1) with real elements «;j If we deal with C, and C,, the only 
difference is that the matrix elements are from the complex number 
field. 

If we now turn to a study of linear operators on X into Y, where X 
and Y are arbitrary finite-dimensional spaces, we shall find the same close 
connection between linear operators and matrices. The reason for this 
is that every n-dimensional real linear space X is in a certain sense the 
same as R, (or the same as C, if X is complex instead of real). This sense 
in which two spaces are said to be the same will now be explained. 


Definition. Two linear spaces X, Y (with the same scalar field) are 
said to be isomorphic if there exists a linear operator T whose domain is 
X, whose range is all of Y, and whose inverse T-! exists. 


In less technical language, X and Y are isomorphic if there is a one-to- 
one correspondence between the elements of X and the elements of Y, 
such that the operations of vector addition and scalar multiplication are 
preserved under the correspondence. That is, if x, and x, have cor- 
respondents y, and y;, respectively, then y, + y? corresponds to x, + x2 
and ay; corresponds to «x. 
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If X is isomorphic to Y and Y is isomorphic to Z, it is easy to see that 
X is isomorphic to Z. 


. Theorem l.4-A.  /f X and Y are both n-dimensional linear spaces with 
the same scalar field, they are isomorphic. 


PROOF. Assume the scalar field is that of the real numbers, for 
definiteness. We shall show that X (and hence also Y) is isomorphic 
to R, from which it will follow that X and Y are isomorphic. Let 
Xj, 7:5, X, be a basis of X. Every x in X has a unique representation 
x = éx oo + &,x,, where é,- -, £, are real numbers. We define a 
linear operator T on X into R, by writing Tx = (€,,---, £j). The facts 
that this is a linear operator, that it has all of R, as its range, and that 
T-! exists are all easily verified, and we omit the details. This completes 
the proof. 

If X is n-dimensional, with a basis x,, ---, x,, the coefficients £, -- +, 
é in the representation x = éx; t :-- + £x, may be called the 
coordinates (or, also, the components) of x with respect to the basis x;, 

X, Thus, the isomorphism of X and R, is established by correlating 
x with the point in R, whose coordinates with respect to the basis e4, 
- ++, €, of R, are the same as the coordinates of x with respect to x1, © © :, X,. 

Suppose now that X and Y are any linear spaces of dimensions n and 
m, respectively, with the same scalar field. Let xj, - - -, x, be a basis in 
X, and y,,---,¥,,a basis in Y. Let A be a linear operator on X into Y. 
Since Ax; € Y, we can write 


m 
(14-3) Ax = Nay. jdm 


i=) 


The operator A, in conjunction with the two bases (xi, * =°, Xa) (y ccs 
Ym), determines an m x n matrix (o;). With this matrix we can calculate 
the vector Ax for every x € X. The calculations are essentially the same 
as those given earlier in the special case Y = R,, Y = Rm; the coordinates 
7; of Ax are given in terms of the coordinates é; of x by equations (1.4-2). 

It must be kept in mind that, although the operator A is represented by 
the matrix (o;;), it is not the same thing as the matrix. For, the operator 
A is not dependent on the particular bases which are chosen for X and 
Y, whereas the matrix does depend on these bases, and the same operator 
is represented by different matrices when different bases are chosen. 

To conclude this section we give an example. 


Example. Let X be the complex linear space consisting of all poly- 
nomials in the real variable s of degree not exceeding n — 1, with complex 
coefficients. Let Y be the corresponding space of polynomials with 
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degree not exceeding m. It is readily evident that Z is of dimension n, 
one possible basis x}, - - -, x, being that defined by 


xQ(s) = 1, x2(s) = S, © X5) = sv}. 
Likewise, Y is of dimension n + 1. X is a subspace of Y. For a basis 


in Y we take Yi = Xis tts Yn Xe Ynxi(5) = sn, 
Now, consider the operator A on X into Y defined by Ax = y, where 


ys) = ik x(t) dt. 


We see that 
1 ; 
Ax, = pues J5 IM. 
The matrix (o;;) in this case is therefore 
EORNM EU 
0 4 0. :0 
0 0 4 0 -0 
:0 
C EP gad 
n 


with n + 1 rows and n columns. 

We observe, incidentally, that the inverse 4^! exists. The range @(A) 
consists of all polynomials of degree < n whose constant term is zero. 
That is, Z(A) is the linear manifold spanned by yz, -.., y,,,. With 
&A) as its domain, 4-! is defined by A~!y = x, where x(s) = y'(s). 


PROBLEM 


Let X and Y be as in the example, but take x, = y, = Py, k = 1, +, 
n, y441 = Pn, where P, is the Legendre polynomial of degree n. Here we have 
bases for X and Y different from the ones previously mentioned. The recursion 
formula 

(2k + DPs) = Peas) — Phils) 


and the known values of P,(0) 
P,(0) = 0 if k is odd 
1-3-5- (k — 1) 
2.4. 


"y if k is even 


-C ope 
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make it possible to compute the matrix of the operator A relative to these bases. 
For n = 6 the matrix is 


I 1-3 
0s 0 -734 0’ ZF% 
10 -¿ 0 0 0 
0 4 0 -4 0 0 
0 0 i 0 —i 0 
00 0 4 0 —-4d 
0 0 0 0 i 0 
0 0 0 0 0 Y 


1.5 Other Examples of Linear Operators 


In this section we give a number of illustrations of problems in analysis, 
as formulated in terms of linear operators. 


Example |. Let G be a nonempty, bounded, connected, open set in 
the Euclidean xy-plane. Let G be the closure of G; then the boundary 
G-G is nonempty. Let H be the class of all real-valued functions f of x, y 
which are defined and continuous on G and harmonic in G (i.e., each f 
must satisfy Laplace's equation in G). Let C denote the class of real- 
valued functions defined and continuous on G-G. Clearly H and C are 
both linear spaces. 

Now, if u € H, u(x, y) is defined at every point (x, y) € G. If we think 
only of the values of u at the points of G-G, we arrive at an element f of 
C defined by f(x, y) = u(x, y) when (x, y) e G-G. We call f the restriction 
of u to the boundary of G. We define a linear operator A on H into C 
by writing Au = f; the fact that A is linear is evident. 

Let us consider existence and uniqueness problems for A (see $ 1.3 fora 
general discussion of these problems). In the present example these are 
problems of potential theory. The uniqueness problem is completely 
disposed of by the well-known fact that, if uc H and u(x, y) ^ 0 on 
G-G, then u(x, y) = 0 at all points of G (since u must attain both its 
maximum and minimum values on the boundary of G). In our present 
notation this means that u = 0 if Au = 0; consequently 47! exists. For 
the existence problem we want to know if Z(A) is all of C. This is the 
famous Dirichlet problem: Is there for each fe C an element u € H such 
that fis the restriction of u to the boundary of G? The answer to this 
question is not always affirmative; Z(4) may be a proper subspace of C. 
However, under certain conditions involving the nature of the set G and 
its boundary, it is known that @(A) = C. In particular, under suitable 
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conditions, Z(4) = C and A-! is defined by an integral, involving the 
Green's function of G, extended over the boundary of G. 


Many boundary-value problems of both ordinary and partial differential 
equations are susceptible of formulation in terms of linear operators, by 
procedures analogous to those of Example 1. It is essential that the 
differential equations be linear and that either the differential equations 
or the boundary conditions be homogeneous. 


Example 2. Let X = Y = C[a, b] (see Example 3, 81.2). Let A(s, t) 
be defined for a < s < b, a < t < b and such that for each x e X the 
Riemann integral 


b 
(1.5-1) Í k(s, t)x(r) dt 


exists and defines a continuous function of s on [a, b]. The values of k 
are to be either real or complex, depending on whether the values of the 
elements of C[a, b] are taken as real or complex. 

The integral (1.5-1) defines a linear operator K on X into X, if we take 
Kx — y to mean 


b 
(1.5-2) "ur f k(s, tyx(i) dt. 


The equation (1.5-2) is called an integral equation. It is of the particular 
sort known as an equation of Fredholm type, of the first kind. 
Another operator T is obtained by defining Tx = y to mean 


(1.5-3) ys) = x(s) — f k(s, t)x(r) dt. 


In this case the integral equation is said to be of Fredholm type, of the 
second kind. Equations of this sort are of great importance. There is a 
well worked-out theory of the existence and uniqueness problems asso- 
ciated with such equations. The applications of this theory play a vital 
role in the theory of boundary-value problems in differential equations. 

A special situation results if we assume that K(s, 7) = 0 when 1 > s. 
The integral (1.5~1) then becomes 


f ; k(s, £)x(t) dt. 


The equations (1.5-2) and (1.5-3), in this modified form, are said to be 
of Volterra type. The theory of Volterra equations of the second kind 
is particularly simple, much more so than the corresponding theory for 
equations of the Fredholm type. Later on in this book we shall treat the 
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theory of integral equations of the second kind, using abstract-linear-space 
methods. For this treatment it is necessary to introduce topological as 
well as algebraic considerations about linear spaces. 


Example 3. Let X = Y = C[0, v]. In this case we assume specifically 
that we are dealing with complex-valued continuous functions. If x e X 
and if x'(s) exists on [0, 7], we denote the derived function by x'. Likewise 
x" denotes the second derivative if x'(s) exists on [0, 7]. We now define 
a linear operator A as follows: Let D(A) = (x:x', x” € C[0, 7] and 
x(0) = x(m) —.0). (See the statement in the Introduction about defining 
subsets of X by the brace notation.) For x € Z(A) define Ax — y to mean 
(1.5-4) — x'(s) + Ax(s) = y(s), 
where A is a complex parameter. The operator A thus depends on A. 
Clearly Z(A) € X. 

We shall discuss the existence and uniqueness problem for A in some 
detail. This amounts to a discussion of finding solutions of the differen- 
tial equation (1.5-4) which satisfy the end cónditions x(0) = x(z) = 0. 

Let one of the square roots of à be denoted by u. By the method of 
variation of parameters the general solution of (1.5-4) (disregarding the 
end conditions) is found to be 


(1.5-5) x(s) = an y(t) sinh p(t — s) dt + Cyexs + Cye-#, 
0 


where C, and C; are arbitrary constants. This is in case A #0. If 
A = 0 the solution may be found by direct integration. If we impose the 
end conditions x(0) = x(v) = 0, we find, first, that C; + C, = 0 and 
then that 


oat Í E ET EE E e 
HJO 


To solve this equation for C; we must assume that sinh mu # 0. On 
substituting into (1.5-5) the values found for Cı, C}. we have 


(1.5-6) xs) = : f * YD sinh p(t — s) dt 


= m. I y(t) sinh plt — «) dt. 


The corresponding formula when A = 0 is 
(1.5-7) x9) = [" woe - 5) dt -È [xo - ») te. 
‘ 0 


It may now be seen that the equation Ax = y admits a solution 
x € GA) for every y € X, provided either that A = O or that sinh mu 4 0 
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if A #0. Moreover, the solution is unique, for it may be argued from 
the standard theory of linear differential equations that (1.5-6) and 
(1.5-7) give, in their respective cases, the only solutions of (1.5-4) 
satisfying the given end conditions. 

There remain to be considered the cases when A z 0 but sinh zp = 0. 
Now, since p? = A and since sinh zz = 0 if and only if mu = imr, where 
n is an integer, we see that the exceptional cases are given by A = — n?, 
n—1,2,3,--.. In these cases (1.5-4) cannot have a unique solution in 
Z(A) (Le., A~! does not exist), for Ax — 0 in case A= — n? and 
x(s) = sin ns. If we re-examine our earlier work, assuming that 
A= — n? £ 0, we see that the equation Ax = y has all its solutions 
x € Z(A) given by 


(1.5-8) x(s) = : Í d y(t) sin n(t — s) dt + C sin ns, 
0 


where C is an arbitrary constant, if and only if the function y satisfies 
the condition 


(1.5-9) f " \(0) sin nt dt = 0. 


This condition serves as a description of Z/(A) in this case. 
T7 S 7 
By writing i = Í + I in (1.5-6), and rearranging somewhat, the 
0 0 5 


formula can be written 


_ fs sinh pt sinh y(r — 5) ig sinh us sinh u(r — t) 
n i Í xo) H sinh pa uS s xo p sinh pr dt. 


If we define 


" sinh wt sinh y(r — s) 


sinh whenO <t<s 
n par 


k(s, £) 
and k(s, f) = k(t, s) when s < t < m, (1.5-6) becomes 
x(s) = f " k(s, 0)y() dt. 


We note that this formula is of the same type as (1.5-2). In our operator 
notation this formula is x = A-!y. Ifweregard x = A !y as an equation 
to be solved for y, we see that it is an integral equation of Fredholm type, of 
the first kind. It has a unique solution, for each x € ZA), given by (1.5-4). 


Example 4. Let X = Y = L(0, oo) (see Example 7, 81.2). Let us 
define an operator A as follows: Consider those functions in (0, oo) 
which are absolutely continuous on [0, a] for every finite a, with derivatives 
also belonging to .Z(0, oo). Each such function determines an equivalence 
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class in .Z(0, oo), i.e., an element of L(0, oo). The set of such elements of 
L(0, oo)isgoingto be Z(4). For convenience we shall drop the notational 
distinction between an element of L(0, oo) and one of its representatives 
in .Z(0, oo). Thus if x € L(0, oo). we shall write x(s) to indicate a 
functional value at s of a representative of x. We then define Ax = y 
to mean that 


(1.5-10) — X'(s) + Ax(s) = y(s) 


almost everywhere on (0, 00). This defines v € L(0, oo) uniquely if 
x €G(A). As in Example 3, A denotes a complex parameter. 

To solve the equation Ax = y, we proceed formally to solve (1.5-10) 
by use of the integrating factor e. If x(s) is absolutely continuous and 
satisfies (1.5—10), it is necessarily of the form 


(1.5-11) x(s) = esc ES f y(e-™ a 


where C is some constant, and, vice versa, the function x(s) so defined, 
for any C, is absolutely continuous and does satisfy (1.5-10). If x(s) 
turns out to belong to .Z(0, oo), it is clear from (1.5-10) that x'(s) will 
also belong, because we assume that y(s) belongs to ¥(0, oo) The 
problem is then that of seeing whether the constant C can be chosen so 


that the integral Í |x(s)| ds will be convergent. In considering this 
0 


problem it is convenient to consider three cases, depending upon whether 
the real part of A is positive, negative, or zero. We write à = a + iB, 
« and B real. Note that 


|x(s)| = es 


ch Í Dem al. 
0 
Case !. «>O0. Since 
f * Ye dr => Í "yer dt as s—> o, 
0 0 


we see that [x(s)| will be of the order of magnitude of ees when s is large 
unless 


(1.5-12) C= I ” X(De-» dt. 


This is therefore a necessary condition for x(s) to belong to ¥(0, oo), 
when « > 0. It is also sufficient; for, if it is satisfied, we have 


(suy ^ Waa f * Abend Í * YG 4+ em du, 
Ss 0 


from which it is easy to see that x(s) e .Z/(0, oo) if « > 0. 
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Case2. « — 0. The condition (1.5-12) is likewise necessary in this 
case. It is not sufficient, however, and whether or not x(s) € .Z/(0, oo) 
will depend on the choice of y. For instance, if 


(t) = ein? 
when t is large, then for large s 


s i œ eiBs 
x(s) = e | ye dt = en | t-2 dt = " 
s Ej 


and x(s) is not in (0, oc). 


Case 3. œ < 0. In this case the function x(s) defined by (1.5-11) is 
in £(0, oo), no matter how C and y are chosen.  This.is easily seen, for 
e^ is in .Z(0, oo), and 


[i voeo ar 
0 
is also in .Z(0, oo). In fact, 


i 


di Í "ds I ° yle- dt 
0 0 


f y(nexs-0 dt 
0 


z ie e-a (A) ar p a AN |») di. 


We can sum up the discussion as follows. The inverse A-! exists if 
« > 0, and the solution x = A4-1y is expressed by (1.5-13). If « > 0, 
&(A) is all of X, but not so if « = 0. When « < 0, 4-1 does not exist, 
but A&A) is all of X. 


Example 5. Let X = L(0, 27). Let F be the class of functions f 
analytic in the unit circle |z| < 1l. For xe X. with representative 
x(s) € L(0, 27), define Ax = f to mean 


1 (7 x(s) 

(1.5-14) f(z) = x |, Posen 

Then 4 is a linear operator on X into F. The inverse A~! does not exist, 
for it is a simple matter to calculate that Ax = 0 if x(s) = e-ims, m = 1, 
2, - - - (use the geometric series for (1 — ze-is)-!, and integrate term by 
term). The problem of characterizing the range #(A) has not yet been 
solved satisfactorily. One would like to know conditions on the analytic 
function f, necessary and sufficient in order that f can be represented by 
formula (1.5-14), with some x € L(0, 7) A simple sufficient, but not 
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necessary, condition is that f be continuous when |z| € 1 as well as 
analytic when |z| < 1. For then, by Cauchy's formula, 


f@) a5 [ Maw, 


the complex line integral being extended counterclockwise around the 
unit circle |w| = 1. If we write w = eis, 0 € s < 2r, this becomes 


Te) 4. 


ze-is 


2r 
fiz) = = 0 I — ze-is 


Thus in this E = Ax, where x(s) = f(e!s). 
A less restrictive sufficient condition is known. Suppose fe F, and 
suppose that there is a constant M such that 


2n 
(1.5-15) Í | f(re!®)| dð < M 


when 0 <r< 1. Then it may be shown that lim f(reis) = x(s) exists 
r1 


almost everywhere on 0 < s < 2« and that x(s) € .Z(0, 27). It may also 
be shown that 


(1.5-16) lim f ?7 i #(rei) — x(8)| dà = 0. 
rol JO 


See § 7.56 of Zygmund, 1; these results are due to F. Riesz, 2. From these 
facts it is easy to prove that Ax = f. Thus, a sufficient condition that 
f € AA) is that f be an element of F satisfying (1.5-15) for some constant 
M and all r such that O < r < 1. 


Example 6. Let X be the class of all infinite arrays of the form 
x= (e, E, £y ép é, 2) where the és are arbitrary complex 
numbers. We denote these more briefly as x = {é}, n = 0, + 1, + 2, 

Define addition and scalar multiplication in the obvious way, i.e., 


(£) + (m) = {Er + m En} = (o£, 


Then X is a complex linear space. Now consider the linear operator 4 
on L(0, 7) into X defined as follows: If f€ L(0, 2:7) with representative 
f(t) € LO, 27), let Af = x, where x = (£,) is defined by 


1 2n 
= —in = +1, + yee 
é, x], fem d, | n20 £152, 
The numbers £, are the complex Fourier coefficients of f. 


The inverse 4-! exists. This is simply the classical theorem that if 
f(t) € LO, 27) and if all of its Fourier coefficients vanish, then f(s) = 0 
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almost everywhere [so that f — O0 as an element of L(0,27)] The 
problem of characterizing &(A) has never been fully solved, though many 
things are known about &(A) from the theory of Fourier series. Many 
interesting and important results have been found by confining attention 
to subspaces of L(0,27) and X. For instance, it is known that if we 
consider the domain of A to be L2(0, 27) instead of L(0, 27), the range of 
A is the subspace of Y consisting of all (£,) for which the series 


oo 


> e 


n=—%0 


is convergent. 


PROBLEM 


Suggestion for showing that Ax = f in the context of the paragraph where 
(1.5-15) occurs: Let C(z, 0) = (1 —' ze). If |z| < r< 1, it may be seen 
from Cauchy's integral formula that 


2" 
fG)- x | C(z,.0)x(0) d0 


1 27 
ou ig 
x |, ee 


27 
(2 o) — C(z,0) dO + x f |f (rei?) — x(0)| |C(z,0)| dê. 


One may then use (1.5-15) and (1.5-16) to obtain Ax = f. 


1.6 Linear Functionals 


The field of real numbers is a real linear space; it is 1-dimensional. 
Likewise, the field of complex numbers is a 1-dimensional complex linear 
space. 

Let X be a real or complex linear space, and let Y be the linear space 
composed by the scalar field associated with X. A linear operator on 
X into Y is then called a /inear functional on X. 

Since we shall have many occasions to deal with linear functionals, we 
shall make certain conventions of notation concerning them. If X is a 
linear space and x is a generic symbol for elements of X, we shall often use 
x’ as a generic symbol for linear functionals on X. If x, € X and if 
xı’ is a linear functional on X, there is no implication of a special relation- 
Ship between x, and x,’. Since x’ is a function, we can speak of its value 
at the point x; by our previous usage this value would be denoted by 
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x'(x) or simply x'x. It will sometimes be convenient to have another 
notation. We shall write 


<x, x 


for the value of x’ at x. This notation has several advantages, as we shall 
see, especially when we replace x’ by a more complicated symbol 
representing a linear functional on X. 

If x,' and x,’ are linear functionals on X and « in a scalar, we define 
X,' + x,’ and ax,’ by the formulas 


(1.6-1) (x, x, F xj» = (x, xy? t (x, x3», 
(1.6-2) CARRY = a CX, XL 


These are the usual definitions for adding functions and multiplying them 
by scalars. The functional x’ such that x'(x) = 0 for every x is denoted 
by 0. Thus, we use 0 to denote the zero scalar, the zero vector in X, and 
the zero functional; the meaning of 0 in a particular occurrence will be 
clear from the context. 

In addition to the formulas (1.6-1) and (1.6-2), we note the formulas 


(1.6-3) (x + x4, x» = QG, X» + Ox XD, 
(1.6-4) (ax, x» = alx, xD. 


These are merely the properties (1.3-1), (1.3-2) of linear operators, 
expressed in the new notation for linear functionals. 


Definition. Let X be a linear space. Let Xf be the class of all linear 
functionals on X. By the foregoing definitions X/ becomes a linear space. 
We call it the a/gebraic conjugate of X. 


We shall see later that the space X7 plays an important role in the 
study of linear operators with domain X. 

Before going further we pause to give some illustrative examples of 
linear functionals. We refer to the examples of linear spaces in § 1.2. 


Example I. Let X be either R, or C,, where n > 1 (see Examples 1, 
2, of $1.2). Since a linear functional on X is a linear operator with its 
range in the I-dimensional space R; or C; (depending upon whether X 
is R, or C,), we can see from § 1.4 that every linear functional x’ € Xf has 
a representation 


(1.5 | <x. x’) = aye Hee + i x = (E52 é, 


where o4, - - -. «, are scalars, and conversely, that every n-tuple of scalars 
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(o1, «++, œ) can be used to define a functional x’ by formula (1.6-5). 
From this we see that, if we define 

Ax = (o, SR ES e); 


then A is a linear operator on Xf into X. We also see that 47! exists 
and that Z(4) = X. Hence, by the definition in 81.4, Xf and X are 
isomorphic in case Y = R, or X = C, 


Example 2. Let X = C[a, b] (see Example 3, § 1.2). Let sọ be a fixed 
point in the interval [a, b]. The formula 


(1.6-6) <x, x» = x(so) 


. defines an element of Xf. Another example of a linear functional is 
furnished by 


b 
(1.6-7) x = [x9 4f. 


where f is an arbitrary function of bounded variation defined on [a, b] 
and the integral is a Stieltjes integral. In case f has a continuous 
derivative, (1.6—7) can be written 


b 
Qs x» = [ xGyr'G ds, 


the integral being a Riemann integral. 

It may be observed that (1.6-6) is a special case of (1.6-7). If sọ = a, 
(1.6-7) reduces to (1.6-6) when we define f(a) — O0 and f(s) = 1 if 
a<s<b. If a< 5) <b, (1.6-7) reduces to (1.6-6) by choosing 
f(s) = 0 when a < s < so and f(s) = 1 when sọ < s < b. 


Example 3. Let X = /2 (see Example 6,8 1.2). Suppose that a = {a,} 
is an element of /2, and define x’ € X^ by 


(1.6-8) (x, x» = » ajén where x = (&). 


i=] 


The series does converge, for, by Cauchy’s inequality, 


> le dil S (S wt) (> ee) 


for every value of n. Therefore, since a € /? and x € /?, the partial sums 
of the series »|o;£,| are bounded, and the series in (1.6-8) is absolutely 
convergent. It is evident that x’, so defined. is a member of X7. 
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Example 4. Let X = L(— oo, oo) (see Example 7, 81.2. If fis a 
bounded measurable function defined almost everywhere on (— oo, oo), 
we can use it to define a linear functional on X as follows: 


(1.6-9) (x, x’) = | * x(s)f(s) ds, 


where x(s) is a function in .Z(— oo, oo) representing the element 
x € L(— oo, oo), and the integral is a Lebesgue integral. 


_ The reader will note that it was only in the case of Example 1 that we 
asserted anything about giving,a general representation of all elements of 
X/. Ordinarily, in dealing with the infinite-dimensional spaces arising 
in analysis, we find it most useful to limit attention to certain subspaces 
of X/. These subspaces are arrived at by imposing a topological structure 
on the space X and then considering only those linear functionals on 
X which are continuous with respect to the topology in question. We 
shall see later that the functionals exhibited in Examples 2, 3, and 4 are 
typical for the respective spaces when suitable topologies are introduced. 

Since X/ is a linear space, we may also consider its algebraic conjugate, 
which we denote by 


(XY, or simply X/f. 
We shall denote elements of X// generically by x", and we shall use the 
notations 
x'(x^) = (x, x^» 
for the value of x" at x’. 
Corresponding to each x in X there is a unique x” in X// defined by 


(1.6-10) Q', x^» = (x, x» 


or equivalently, x'(x') = x'(x). That this formula does in fact define a 
linear functional on X/ is apparent from (1.6-1) and (1.6-2). The 
correspondence between x and x" in (1.6-10) defines a linear operator J 
on X into X//: Jx = x". The fact that J is linear is apparent from 
(1.6-3) and (1.6-4). 


Definition. The mapping of X in X// by the operator J is called the 
canonical mapping of X into X/f. 


It will be shown in Theorem 1.71-C that J has an inverse, that is, that 
Jx — 0 implies x — 0. If X is finite dimensional, this is shown in 
Theorem 1.61-B. It follows from this fact that the range of J is iso- 
morphic to X. Hence we may identify X and the range of J, thus permit- 
ting ourselves to look upon X as a subspace of X/f. When we adopt 
this point of view, we speak of the canonical imbedding of X in X/f. 
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Definition. If Z(J) = X//, we say that X is algebraically reflexive. 


It turns out, as we shall see later, that X is algebraically reflexive if and 
only if it is finite dimensional (Theorem 1.72-A). 


PROBLEM 


Show that, if X is algebraically reflexive, so is Xf. Suggestion: Let Jọ and J, 
be the canonical mappings of X and Xf into X/f and X/// respectively. The 
problem is to show that 2(Jj) = X///. If x" € X//7 is given, define x’ e X^ 


by the formula <x, x? = <Jox, x"». Show that J,x’ = x”. 


1.61. Linear Functionals in Finite-Dimensional Spaces 


Let X be an n-dimensional linear space, and let x,, ---, x, be a basis of 
X. Let x = £i +--- 4 &x, be the representation of an element 
xex. For any x’ e Xf we have 
(1.61-1) x(x) = &x' Gi) ts + Ex (x). 
The coefficients x’(x,),.---, x'(x,) are independent of x. This set of 
coefficients may be prescribed arbitrarily; that is, given any n scalars 
94, 5, €, there exists a unique x’ e X/ such that x'(x;) = api = 1,0% 
n. This x' is given by 
(1.6122) x(x)-9 Sa,  wherex- > £x, 
2 > 

The case in which one a; is 1 and the others are 0 is of especial interest. 
Ife; = 1,06; = --- =a, = 0, denote the corresponding x’ by xı’. Then 
x(x) = 10, xj'(x?) = 5 = xi (x, 2 0. We define xy’, ---, x,’ in 
similar fashion. Specifically, for each k(k = 1, ---, n) let a; = ŝip, and 


denote the corresponding x’ in (1.6-2) by x,'. The essential character of 
the functionals x,’, ---, x,’ is then exhibited in the equations 


(1.61-3) Xp Xk = S RS Len 


To demonstrate this we observe that 


Xj = 2: 9ijXi, xy (x;) ET > Six à = Sik: 
iz i=1 


Theorem l.61-A. The set xi^, - - -, x, defined in the foregoing discussion 
is a basis of Xf. Hence the algebraic conjugate of an n-dimensional linear 
Space is n-dimensional. 
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PROOF. The set xj, ---, x, is linearly independent. For, from 
Bi! +--- + Bax, = 0 it follows with the aid of (1.61-3) that 


B; <x; x; = > B; 94 = Bj, 
i=l 


or fi =-=, —0. Next, for a given x’ € XS we define «; = x'(xj) 
and prove that 
(1.61-4) X = aX) ded ax, 


thereby completing the proof of the theorem. The meaning of (1.61—4) 
is that, for every x € X, 


(1.61-5) x(x) = axi (x) +++ oux). 


The validity of this formula is readily verified with the aid of (1.61—2) 
and (1.61—3). 


Definition. The basis x,',---, x,' of X7, as defined in the foregoing 
work, is said to be dual to the basis x;,---, x, of X. 


Corresponding to each basis of X there is a uniquely defined dual 
basis of Xf. 


Theorem l.61-B. Jf X is n-dimensional and if x € X is such that 
x'(x) = 0 for every x' € Xf, it follows that x = 0. In other words, Jx = 0 
implies x = 0, so that J-! exists. 


PROOF. We use the basis x4, ---, x, and its dual x;',---, x,'. In the 
notation of (1.61-4) and (1.61-2) we have œf + --- + e£, = 0 for all 
choices of «,,-+-, œp, This implies é =--- = é, = 0, and so x = 0. 


Theorem l.61-C. If X is ann-dimensional linear space, it is algebraically 
reflexive. 


PROOF. We assume n > 0, since the case n = Ois trivial. By Theorem 
1.61-A both Xf and X// are n-dimensional. Consider the canonical 
mapping J of X into X// (see $ 1.6).Si nce J~! exists, A(/) is n-dimensional 
by Theorem 1.3-D. Hence Z(J)-- X//, by Theorem 1.1-E. This 
completes the proof. 


Theorem l.6I-D. Let M be a proper subspace of the n-dimensional 
linear space X, and suppose xo € X — M. Then there exists an element 
Xo € XF such that xo(x) = 0 if x e M and xg (xo) = 1. 


PROOF. Suppose M is m-dimensional. The trivial case m — O is left 
to the reader, and we consider the case 0 < m < n. Let xj, ---, Xm be 
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a basis of M, and write x,,, = xy. The set xj, +++, X,41 is linearly 
independent. By Theorem 1.1-D we can find a basis of X whose first 
m + 1 vectors are xj, «s, X444. Let xi, +--+, x,’ be the dual basis of 


Xf, and define x9’ = x/,,;. Then the conditions required in the theorem 
are satisfied. 

The proofs of Theorems 1.61—B and 1.61—D have been given by methods 
depending on finite dimensionality. But the theorems are true if the 
assumption of finite dimensionality of X is dropped. The proofs in this 
general case require more profound methods, however; see § 1.71. 


PROBLEM 


If X^ is n-dimensional, so is X. 


1.7 Zorn’s Lemma 


What is commonly known as Zorn’s lemma was originally formulated 
by Zorn as a proposition in the theory of sets, which he showed to be 
equivalent to the axiom of choice. Subsequently, this proposition has 
been given a formulation in terms of partially ordered sets which is 
extremely convenient for many applications. In this book we state 
Zorn's lemma and use it as the need arises. It is immaterial whether the 
reader chooses to regard the lemma as an axiom of set theory or as a 
theorem derived from the axiom of choice. 

Our statement of Zorn’s lemma depends pow the notion of a 
. partially ordered set. 


Definition. Let P be a set of elements. Suppose there is a binary 
relation defined between certain pairs of elements a, b of P, expressed 
symbolically by a < b, with the properties: 


1. If a < b and b < c, then a < c. 
2. IfaeP then a < a. 
3. If a < b and b < a, then a = b. 


Then P is said to be partially ordered by the relation. 


For example, if P is the set of all subsets of a given set X, the set 
inclusion relation (A C B) gives a partial ordering of P. The set of all 
complex numbers z = x + iy, w = u + iv, --- is partially ordered by 
defining z < w to mean that x < u and y < v, where < has its usual 
meaning for real numbers. 
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If P is partially ordered and if, moreover, for every pair a, b in P either 
a <b or b < a, then P is said to be completely ordered. (The adjectives 
linearly, totally, and simply are also used in place of completely.) 

For example, the real numbers are completely ordered by the relation 
**q is less than or equal to b.” 

A subset of a partially ordered set P is itself partially ordered by the 
relation which partially orders P. Also, a subset of P may turn out to be 


completely ordered by this relation. 
Jf P is a partially ordered set and S is a subset of P, an element me P 
is called an/upper bound of S if a< m for every ae S. An element 
m € P is said to be maximal if a € P and m < a together imply m = a. 


Zorn's Lemma. Let P be a nonempty partially ordered set with the 
property that every completely ordered subset of P has an upper bound in P. 
Then P contains at least one maximal element. 


Some applications of this proposition will be found in §§ 1.71, 1.72. 


I.7] Extension Theorems for Linear Operators 


If X is a set, M a proper subset of Y, and f a function defined on M, 
a function F defined on X is called an extension of f if F(x) = f(x) when 
xe€M. In practice, we are usually concerned with extensions which 
conform to certain additional requirements. Often these requirements 
are of the sort which state that the extension F is to have certain of the 
properties possessed by f (e.g., be bounded, or continuous, or differ- 
entiable, or analytic, etc.). The question as to whether an extension of 
the required sort exists may be easy or difficult to answer, depending on 
the particular nature of the problem. In this section we are concerned 
with the existence of an extension when X is a linear space, M is a proper 
subspace, and f is a linear operatoron M into a second linear space Y. 
We require the extension F to be linear on X into Y. There may also be 
further conditions on f and F. 


Theorem 1.71-A. Let X and Y be linear spaces and M a proper subspace 
of X. Let f be a linear operator, defined on M into Y. Then, there 
exists a linear operator F defined on X into Y such that F is an extension 


of f. 


PROOF. Choose any element x) EX — M, and let Mg be the subspace 
of X spanned by the set consisting of M and xy. Any element of Mọ can 
be written in one and only one way in the form x + axo, where xe M 
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and «is some scalar. The uniqueness of the representation follows from 
the fact that, if x, + a,x) = X2 + exo, where xj, x€ M, then 
X; — X? = (a, — aj)xg, whence (a, — e;)xo € M, since M is a linear 
manifold. But, since xo € M, we are forced to conclude that a, — œ, = 0, 
since otherwise xg = (a; — «,)~a. — «,)xg would also be in M. Hence 
also x, — x4 = 0, and the representation is unique. 

We now define a linear operator Fy on My into Y as follows: 


Fo(x + axo) = f(x) + ayo, 


where yo is some fixed vector in Y. For our present purpose it does not 
matter how yg is chosen. It is readily seen that Fo is an extension of f 
and that it is a linear operator on Mọ into Y. 

It now seems plausible to suppose that by a continuation of the 
procedure we can arrive at the required extension F defined on all of X. 
Indeed, if X is finite dimensional, we shall arrive at the desired goal in a 
finite number of steps. For the general case the argument is made 
precise by use of Zorn's lemma. 

Let g be a linear operator with domain Z(g) — X and range Z(g) c Y; 
suppose M is a proper subspace of Z(g) and that g is an extension of f. 
Let P be the class of all such operators g. Sf g, heP, let us define the 
relation g < A to mean that Z(g) c 2(h) and that h is an extension of g. 
This relation defines a partial ordering of P. Moreover, P is nonempty, 
for certainly Fy € P. 

Now suppose that Q is a completely ordered subset of P. We shall 
define an element G € P which is an upper bound of Q. Let &(G) be the 
union of all the sets Z(g) corresponding to elements g€ Q. This set 
Z(G) is a subspace of X. For, suppose xi, x? € Z(G). Then, there exist 
elements gi, g) € Q such that x, € Z(g,) (k = 1, 2. We may suppose 
gı £» since Q is completely ordered. Then 2(g,) =€ Z(g;), and so 
X; + x;,€Z2(g;)C GG). Closure of AG) under multiplication by 
scalars is proved even more simply. Now, suppose x € Z(G). Then 
x € Z(g) for some ge Q. We shall define G(x) = g(x). This definition 
is unambiguous, for, if x e Z(gj) and x €Z(g;), where gi, g; € Q, we 
have g,(x) = g(x) by the fact that Q is completely ordered. The proof 
that G is linear is like the proof that Z(G) is a linear manifold. It is 
clear that G € P and that g < G for every g € Q. 

We now know that P satisfies the conditions of Zorn's lemma and 
must, therefore, contain a maximal element, say F. The domain of F 
must be all of X, for otherwise we could regard Z(F) as the M in the first 
part of the proof and thus obtain an element g € P with g # F, F < g, 
contrary to the maximality of F. The proof of the theorem is now 
complete, for F has the properties required in the theorem. 
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Theorem 1.71-B. Let X, be a proper subspace of the linear space X, 
and suppose xy € X — Xo. Then, there exists an element x,’ € Xf such that 
(x, x> = 0 if x e Xy and that (xi, xy» = 1. 

PROOF. We observe that this is the same as Theorem 1.61-D with the 
hypothesis of finite dimensionality omitted. To prove the theorem, let 
M be the subspace of X spanned by the set consisting of X, and x. 
Elements of M are uniquely representable in the form x + «xı, where 
x € Xo anda is a scalar. (See the argument at the beginning of the proof 
of Theorem 1/71-A.) Let us define f(x + exi) = a Then f is a linear 
functional øn M, and f(x) =0 if x&.Yy whereas /(x,)-— 1. By 
Theorem 1.71-A (with Y the linear space of scalars) there exists an element 
of X^ which is an extension of f. If we denote this element by xı’, we 
see that it has the required properties. 


Theorem 1.71-C. Let X bealinearspace. Ifx&€X and if <x, x'» 0 
for every x' € XS, then x — 0. In other words, J-! exists, where J is defined 
as in $ 1.6 [see (1.6—10)]. 

PROOF. Applying Theorem 1.71-B with Xo = (0) we see that if x, x 0, 
there exists xı’ € Xf such that (xj, xi» #0. This statement is merely 
the contrapositive form of Theorem 1.71-C, so the proof is complete. 
Note that this proposition is the same as Theorem 1.61-B with the 
hypothesis of finite dimensionality omitted. 

Next we consider an extension theorem for linear functionals which are 
subjected to a special kind of condition. 


Definition. Let X be a real linear space, and let p be a real-valued 
function defined on X, with the properties 
a. p(x + y) € p(x) + p(y), 
b. plex) = apx) ifa 2 0. 
We call p a sublinear functional on X. 

As an example of a sublinear functional we cite the example of the 
space X = R, with p defined by p(x) = |é| +--- + léh, where 
x= (é, é). Another example is that of X = C[{a, 4], with 
p(x) = |x(a)| or p(x) = max |x(t)| fora < t < b. 


Theorem 1.71-D. Let X be a real linear space, and let M be a proper 
subspace of X. Let p be a sublinear functional defined on X and let f be 
a linear functional defined on M such that f(x) < p(x) for each x e M. 
Then, there exists a linear functional F defined on X such that F is an 
extension of f and F(x) < p(x) for each x € X. 


PROOF. We have arranged the notation so that the proof can be given 
in a somewhat abbreviated form by referring to the proof of Theorem 
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1.71-A. We start with xy and Mo as in that proof. The first problem is 
to show that there exists a real number £o such that the linear functional 
Fo defined on M, by 


(1.71-1) F(x + axo) = f(x) + odo 
satisfies the inequality 
(1.71-2) Fo(x + axo) € p(x + axo) 


for every real « and every x € M. 
By taking « = 1 in (1.71-1) and (1.71-2) we see that one necessary 
condition which must be satisfied by £y is the inequality 


(1.71-3) Éo < p(x + xo) — fC), 

which must hold for every x e M. Another similar necessary condition is 
obtained by taking « = — 1 and replacing x by — x in (1.71-1) and 
(1.71-2). In this way we see that the inequality 

(1.71-4) — p(— x — xo) — f(x) < é 


must hold for every x e M. 

Now, conversely, if (1.71—3) and (1.71-4) are valid inequalities for every 
x € M, it follows that (1.71-2) is always satisfied. To see this, suppose 
a > 0, and replace x by «-1x in (1.71-3). Then 


& < a + x) — £(2) = ire axo) = ifs 
and so, rearranging, 
f(x) + odo < p(x + axo) 
for xe M and « > 0. If « < 0, replace x by «-!x in (1.714). Then 


x l 


£o 2 - (- Z = xo) -r( = PLUS + axo) — Lo, 


— p(x + axo) + f(x) < — o£, 
and so 


f(x) + af € p(x + axo) 
if x € M and a < 0. These two results together show that (1.71-2) is 
always true (the case « = 0 is obvious). 
Now, suppose x, and x; are any elements of M. Then 
S) — fox) = f(x; — xi) € p(X, — xi) 
= p[(x2 + xo) + (—x, — Xo)] < p(x2 + xo) + p(— xi — xo), 
whence 


(1.71-5) — p(— x, — x9) — fGxi) € p(xa + xo) — f(x»). 
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Let 
c= sup {— p(— x — xo) — f(x) 


C= inf {p(x + Xo) — f(x)}. 


We see by (1.71—5) that c € C, both c and C necessarily being finite. 
There certainly exists a real number & such that c < é < C, and it will 
satisfy (1.71-3) and (1.71-4) by the way in which c and C are defined. 
We then define Fy by (1.71-1), and (1.71-2) is satisfied. This completes 
the first phase in the proof of Theorem 1.71-D. 

The proof is completed by use of Zorn's lemma in essentially the same 
way as in the proof of Theorem 1.71-A. We consider the class P of all 
linear functionals g with Z(g) c X such that M is a proper subspace of 
Hg), g is an extension of f, and g(x) < p(x) when x € Z(g). The partial 
ordering of P is defined as before, and the rest of the proof is essentially 
as before. 


1.72 Hamel Bases 


The German mathematician Hamel conceived the notion of a “‘ basis” 
for all real numbers as follows: Let H be a set of real numbers with the 
properties: 


1. If x, +--+, x, is any finite subset of H and if r,,---, r, are rational 
numbers for which rax, +--+ + r,x, = 0, then rj =--- =r, =0. 

2. Every real number x can be expressed as a finite linear combination 
of elements of H, with rational coefficients. 


In terms of such a basis, Hamel (1) then discussed real functions f 
satisfying the equation f(x + y) = f(x) + f(y) for all real x, y. If H is 
a basis in the foregoing sense, let a real function f be defined as follows: 
If x € H, assign the values of f(x) arbitrarily. Any real x has a unique 
representation x = rx, +--+ + r,x,, where xi, ++, x, are in H and 
Fi, Fa are rational (n may vary with x, of course). We then define 
f) = rfix) +--+ + ruf(x,) the values f(x1), <- +, f(x,) having already 
been assigned. With this definition f turns out to satisfy the condition 
f(x + y) = f(x) + f(y) for every x and y. This procedure gives all 
possible functions f satisfying this condition. 

To show the existence of a basis for all real numbers, Hamel used an 
argument based on the proposition that every set can be well ordered. 
This proposition is equivalent to the axiom of choice, or to Zorn’s lemma. 

Hamel's whole procedure can be adapted to the purpose of showing the 
nature of all possible linear functionals on a linear space X. 
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Definition. Let X be a linear space with some nonzero elements. A 
set H C X is called a Hamel basis of X if: 


1. H is a linearly independent subset of X. 
2. The linear manifold spanned by H is all of X. 


To show the existence of a Hamel basis, let P be the class whose members 
are the linearly independent subsets of X. Let P be partially ordered 
by the relation of set inclusion (i.e., M < N if M, N e P and MC N). 

It is easy to see that P satisfies the conditions of Zorn's lemma. For, 
if x, # 0, the set consisting of x, alone is in P, and, if Q is a completely 
ordered subset of P, the subset of X obtained by taking the union of all 
the subsets of X comprised in Q is in P and is an upper bound for Q. 
Hence P must contain a maximal element, say H. Then the linear 
manifold spanned by H must be X. For, otherwise, some element x of 
X is not in the linear manifold spanned by H, and the set consisting of x 
and the elements of H is linearly independent and contains H as a proper 
subset, contrary to the maximal character of H. Thus H is a Hamel 
basis of X. 

If x €X/, we have x(x) = ax’ (x1) +- + «,x(x,) whenever 
X = ax, +--- + o,x,, the e's being any scalars. Conversely, suppose 
H is a Hamel basis of X. Define x’ by assigning the value of x'(x) 
arbitrarily when x € H, and define x'(x) = ejx'(xi) +--+ + a,x’(x,) if x 
is any element of X, uniquely represented in the form x = ox, +--- 
+ a,x, where x,,---, x, are in H and a, ---, «, are scalars. Then 
x’ € Xf, as is easily seen. 

By using the concept of a Hamel basis, we can show that no infinite- 
dimensional space is algebraically reflexive. First we observe that, if S is 
a linearly independent subset of X, there is a Hamel basis H of X such 
that S is a subset of H. This is shown by use of Zorn’s lemma, taking P 
to be the class of all linearly independent subsets of X which contain S. 


Theorem I.72-A. If X is infinite dimensional, it is not algebraically 
reflexive. Consequently (see Theorem 1.61-B), a linear space is alge- 
braically reflexive if and only if it is finite dimensional. 


PROOF. Let H = {x,;:ie€ I) be a Hamel basis of X. Then Z is an 
infinite index set, and x; # x; if i # j. Define x; € X/ by x(x) = 1, 
x; (x) = O if i 4 j. Then the set (x;':i € I} is a linearly independent set 


n n 
in Xf. For, if we suppose that » «,X;) = 0, we have 0 = 2 e, X; Xi) 
v=1 v=1 
=a, when p = 1,---, n. Now let H' be a Hamel basis of X^ which 
contains the set (x;':i € I}. 
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Let (B;:i € I} be a set of numbers such that B; # 0 for infinitely many 
indices i. Define x" € X// by setting x'(x;j) = B; and x'(x) = Oifx'e H’ 
but x’ is not one of the elements x;. Consider an element x9” e X/£ of 
the form x9” = Jx, x e X. We have xo'(x;) = x; (x) = aj, where o; is 
the coefficient of x; in the representation of x in terms of the Hamel base 
H. Since «; = 0 for all but a finite number of indices i, it follows that the 
set of «;'s cannot be the same as the set of f;'s, and therefore x" 4 xy". 
This shows that X/f contains elements not in the range of J, so that X is 
not Ln reflexive. 


PROBLEMS 


|. If H, and H, are any two Hamel bases for X, they have the same cardinal 
number. For each x € H, let H;(x) be the finite set of those elements of H, 
which are needed to represent x by using the basis H}. Show that, if y € H,, 
then y € H,(x) for some x € H,, and hence that 


A = U Hx). 


xeH, 

The cardinality argument from here on is like that used in another context later 
in this book; see the last part of the proof of Theorems 3.2-0, following (3.2-11). 

2. The cardinal number of a Hamel basis of X is called the dimension of X. 
In the case of a space X of infinite dimension, the cardinal of X itself can be 
shown to be the product C: dim X, where C is the cardinal of the set of all real 
numbers and dim X is the dimension of X. Since this product is just the 
larger of the two factors, the cardinal of X is C if dim X « C and dim X if 
C x dim X. See Jacobson, 1, Chapter 9, and Lowig, 1, p. 20. 

3. The dimensions of X and X/ are related as follows, provided that dim X 
is infinite: 

dim Xf = Cdim X, 


See the reference to Jacobson in the foregoing problem. It follows that X 
cannot be algebraically reflexive if dim X is infinite, for in that case dim Y « dim 
Xf. We can also write dim X/ = 2dim X in this case. For, we have C = 2No, 
and Xo N = N for any infinite cardinal N, whence CN = 28, 


1.8 The Transpose of a Linear Operator 


Suppose X and Y are linear spaces, and let A be a linear operator on 
X into Y. Let X/ and Y/ be the algebraic conjugates of X and Y 
respectively. We use the notations introduced in § 1.6. To each y' e Y^ 
let us make correspond the element x’ e X^ defined by 


(1.8-1) (x, x? = (Ax, y^, 
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where x varies over all of X, and let us denote the function so defined 
by AT: ATy' = x’. It is easy to check that AT is a linear operator on 
Yf into Xf. We leave the verifications to the reader. Equation (1.8-1) 
may now be written in the form 


(1.8-2) (x, ATy’> = (Ax, y), xeX, y € VS, 
This formula defines AT. 


Definition. The operator AT defined by (1.8-2) is called the transpose 
of A. 


To see the motivation for this terminology, let us consider the case in 
` which X and Y are finite dimensional. Let X be n-dimensional, with 
basis x4, ++ -, x,, and let Y be m-dimensional, with basis y;,---, Ym- Let 
the corresponding dual bases in Xf and Yf be x,’, ---, x,’ and yy’, +++, 
Ym respectively (see § 1.61). We know from § 1.4 that the operator A 
determines, and is determined by, a matrix 


O11 912 Xin 
a21 022 ^'^ On 
(1.8-1) MEN "o conoce 
Xml Cu2 C7 Omn 


(1.8-2) AX; = > «uy; j == l, SES A. 


Since AT is a linear operator on Y^ into X/, it follows that AT is determined 
by a certain matrix 


Bu Biz TM Bim 
Bai B22 Bom 
(1.8-3) RET wae 
Pri [^ Pu Bam 
and the set of equations 
(1.8-4) ATy/ = BuiXe’s d = 1,- m. 


If we use the relations between a basis and the dual basis, we shall be 
able to find the relation which the matrix (1.8-3) bears to the matrix 
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(1.8-1). We know that <x;, x,» = 9j, [see (1.61-3)) and likewise that 
(yj Yi? = 94. Consequently by (1.8-2), 


(AX, yj) = ( > ki Yks w) = > Oy; Öki = er. 
k=1 k=l 


But also, by (1.8-4), 


n X n 
sah = x, ATy;'> = ( > Puti) = > Bei 9j, = Bj. 
k=1 k=1 


Therefore 
(1.8-5) aj = By. 


In other words, the matrix (1.8-3) has for its Ath row the kth column of 
the matrix (1.8-1). In the customary terminology of matrix algebra, the 
matrix (1.8-3) is the transpose of the matrix (1.8-1). It is on this account 
that the operator 47 is called the transpose of A. 

The main reason for introducing the notion of the transpose of a linear 
operator is that the discussion of the existence of 4-1 and the description 
of the range Z/(A) are facilitated by considering the transpose operator 
AT. We shall see this in § 1.91. 


1.9 Annihilators 


The material of this section will be used in the following section, § 1.91, 
where we discuss certain relations between a linear operator A and its 
transpose AT. In the present section we do not consider linear operators. 
Instead, we are concerned with certain linear manifolds in X and X7, 
where X is a linear space and X is its algebraic conjugate. 


Definition. Suppose S is a nonempty subset of X. Then S? denotes 
the set of all x’ € Xf such that (x, x’) = Oif x eS. This set S? is called 
the annihilator of S in X/. 


Several obvious facts may be noted: 
S? is a linear manifold, whether S is or not. 


(1.9-1) (09— x^, X°=(0); 
(1.9-2) S, C S implies 5,9 c Sj9. 


It will be of particular interest to us to consider the annihilator of the 
range of a linear operator. 
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If we consider a nonempty subset S of X7, it will have an annihilator 


in X//, namely, the set of all x” € X/T such dil —-0ifx'es. 
However, it is also useful to consider another no follows: 


Definition. If S is any nonempty subset of Xf, we use the symbol 
. 9$ to denote the set of all x € X such that (x, x'» = 0 if x & S. This 
set %S is called the annihilator of E in X. 


We observe the facts: 
l | 9S is a linear manifold, whether S is or not. 
(1.9-3) (0 =X, XS) = (0). 
(1.9-4) Sı € S; implies 9S; c 0S). 


` The relation (XS) = (0) in (1.9-3) follows from Theorem 1.71-C. 
If S c X7, there is a very simple relation between the annihilator of S 
in X and the annihilator of S in X//. If we think of X as a subspace of 
_ Xf, via the canonical imbedding (see § 1.6), then 9S is just that part of 
S? which lies in X. If we use the canonical imbedding operator J, the 
. exact relationship between S° and °S is expressed in the formula 


(1.9-5) JOS) = J(X) A S9. 


The verification of this formula is left to the reader. It is an immediate 
consequence of the definitions. 

The first important theorem about annihilators is as follows; it concerns 
the annihilator of an annihilator: 


Theorem 1.9-A. If S is a nonempty subset of X, then 9(S9) is the 
linear manifold spanned by S. In particular, if M is a subspace in X, we 
have 


(1.9-6) «M?) = M. 


PROOF. Let M be the linear manifold spanned by S. If x = a,x; + 
ob ex, Where xi, © +4, x, E S, and if x’ € S°, we have 


(x, x» = 0X1, X» brs eu QS X» = 0, 


so that x € (S9), Thus M c (S9). If we suppose xo € (S9) — M, we 
know by Theorem 1.71-B that there exists an element x’ € X/ such that 
(x, xo» = Oif x e M, but (xo, xo» # 0. The first of these two conditions 
On Xo’ implies that xy € S9, because S C M. But then (xg, Xo» = 0, - 
because Xo € (S9). We have now reached a contradiction. Therefore 
(S9) c M, and the proof is complete. 
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Corollary 1.9-B. If M, and M; are subspaces of X such that 
M9? = M£, it follows that M, = M3. 


PROOF. By (1.9-6) we have M, = %(M,°) = (M5?) = Mp. 
In case of finite-dimensional spaces we have: 


Theorem 1.9-C. Let X be a linear space of dimension n, and let M 
be a subspace of X, of dimension m. Then the annihilator M? has dimension 
hn — 


PROOF. We assume that n > l and that M is different from (0) and 
from X, so that O < m < n. The proof is very simple otherwise, and we 
leave the verification to the reader in these other cases. Let x, >, x 
be a basis for X such that x,,---, Xm is a basis for M. Letxj,,--, x, 
be the dual basis of Y/. Suppose xe M. Then x = £x, +--+ + Ex, 
where £, = Oif m « i n. Hence, if m < j & n, (x, x» = EX, xj? 
se ar E xj» = 0, because of the relations (1.61-3). This shows 
that x € M°. On the other hand, if x’ € M°, we have x’ = éxi' +--+ 
+ EX, and, if 1<i<m, 0-,.x»-—é£',x +++ + É 
(Xj, X,» = é’, again by (1.61-3). Thus x’ is in the linear manifold 
spanned by xhi ..., x,. These two results together show that 
Xmuipcio XQ, constitute a basis for M9, which therefore has dimension 
n — m. 

Next we consider the situation analogous to that of Theorem 1.9-A 
when we start with a subset of X/. 


Theorem 1.9-D. Suppose S is a nonempty subset of Xf, and let M be 
the linear manifold spanned by S. Then 


(1.9-7) M c (SX. 


The proof is simple; we leave it to the reader. 
Unlike the situation in Theorem 1.9-A, it can happen that M z (0M) 
when M is a subspace of X/. An example will be given presently. 


Theorem I.9—E. Let M bea proper subspace of Xf. Then M = OMX 
if and only if to each x' € X^ — M corresponds some x € 9M such thai 
(x, x") # 0. 


PROOF. By(1.9-7) we know that M c (°M)°. Hence (0M)? = M if anc 
only if (0M)? c M. Fora given x’ € X/ the statement “to x' correspond: 
some x € 9M such that <x, x’) # 0” is equivalent to the statement **x' i: 
not in(°M)9. Thus the theorem can be rephrased as follows: (0M)? — X 
if and only if x' € Y^ — M implies x' € Xf — (9M)9. In this form thi 
assertion is obviously true, since a set-theoretic inclusion relation i 
reversed when we pass from the sets to their complements. 
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Definition. A subspace M of X/ is called algebraically saturated if 
M = (My. 


We see by (1.9-3) and (1.9-1) that (0) and X7 are both algebraically 
saturated subspaces of Xf. Also, it follows from (1.9-6) that, if M is 
any subspace of Y, its annihilator M? is an algebraically saturated sub- 
space of X/. 


Theorem I.9-F. Jf M, and M, are algebraically saturated subspaces 
of Xf and °M, = 9M,, it follows that M, = M2. 


PROOF. M; = (0Mjf = (0M; = M2 


Theorem 1.9-G. If X is finite dimensional, every subspace of Xf is 
algebraically saturated. 


PROOF. Let M be a subspace of X/, we can assume M # X7, since we 
already know that X~ is saturated. Suppose x)’ € Xf — M. By Theorem 
1.61-D there exists an element x” € M? such that xo”(xọ) = 1. But X 
is algebraically reflexive, and so there is an element xọ € X such that: 
Jxo = xg". Then <xo, Xo > = (xo, x9? = 1. The fact that x9” c M? 
implies that (xg, x> = <x’, xo» — 0 if x eM; therefore xo e ?M. 
Consequently M is algebraically saturated, by Theorem 1.9-E. 

We now give an example in which M # (9M )9. 


Example I. Let X be the space consisting of all convergent sequences 
x = {£}, with addition and scalar multiplication defined in the natural 
way. Let M be the subspace of X/ consisting of all linear functionals 
X' expressible in the form 


(1.9-8) (x, x = > éé where > lé] < oo. 
i=] i=] 


Let x’ be the particular element of X^ defined by 
(1.9-9) (x, X9» = lim é. 


We shall show that x9’ € (9M)? — M. First we show that (0M)? = X7, 
so that certainly x9’ € (0M)9. Suppose that x € ^M, i.e., that <x, x» = 0 
for each x' € M. For any given positive integer n let é; = 0 if i 4 n, 
é = 1, and let x’ be the corresponding element of M, as in (1.9-8). 
Then 0 = (x, x’> = €,; this is true for n = 1,2,---,andsox = 0. This 
shows that ^M = (0); it follows that (0M)? = X7. Next we show that 
Xo is not in M. For, if we suppose Xx)’ € M, we have a representation 


(1.9-10) cx, xo = > fan D lal< c. 
i=l i-l 
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For a given k let x be chosen with é, — O0 if n # k, £, — 1. Then, 
comparing (1.9-9) and (1.9-10), we see that «p = 0. This holds for each 
k, so (1.9-10) tells us that <x, x9» = 0 for every x. This is false, for 
(1.9-9) shows that <x, x9’) = 1 when x is defined by £j = é=. — I. 
We have thus shown that xo €(9M)? — M. Therefore M is not 
algebraically saturated. 


1.91 Ranges and Null Manifolds 


In this section we consider an arbitrary linear operator A on X into Y, 
where X and Y are linear spaces with the same field of scalars. In § 1.3 
we discussed in general terms two important questions which arise in 
connection with a linear operator: (1) For which elements y € Y does the 
equation Ax = y have a solution x? (2) Is the solution unique in all 
cases in which a solution exists? The first question leads us to seek 
various ways of characterizing the range Z(4). The second question is 
the same as the question: “Does the inverse A~? exist?" In the present 
section we investigate these questions with the aid of the transpose 
operator AT (see § 1.8) and the annihilator concepts developed in § 1.9. 


Definition. By the null manifold of A is meant the set of all x e X 
such that Ax = 0. We denote this set by (A). 


It is evident that. (A) is a linear manifold in X. 

The definition of null manifold can be applied to the transpose AT, so 
that (AT) is the set of all y' e Y/ such that ATy' = 0. 

We recall that the inverse 4-1 exists if and only if Ax = 0 implies x = 0, 
that is, if and only if//(A4) = (0). 

Our first results deal with the relations between A(A) and (AP). 


Theorem 1.91-A. {2(4)}} = (AT). 


PROOF. By definition of AT we have (Ax, y'» = (x, ATy'» for x € X, 
y € Yf. If y' e (2(A))? we see that (Ax, y’> = 0 for each x € X, and so 
ATy' = 0, or y' eJ (AT). The reasoning is reversible, and so the theorem 
is proved. 


| Theorem 1.91-B. (A) = 9(A(A7)). 


PROOF. &#(A) = 9(2:(4)) = HM (AT), by Theorems 1.9-A and 
19.1-A. 


Theorem 1.91-C. &(A) = Y if and only if (AT)! exists. 
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PROOF. Z/(A4) = Y implies (AT) = Y? = (0), by Theorem 1.91-A and 
(1.9-1). But (AT) = (0) is equivalent to the existence of (47)7!. Thus, 
JA) = Y implies the existence of (47)-1. Conversely, (A7) = (0) 
implies (A) = 0) = Y, by Theorem 1.91—B and (1.9-3). 

The foregoing theorems give us what we want with respect to (A). 
Next we seek to obtain information about. (A) by considering (AT). 


Theorem 1.91-D. (A) = 9((AT)). 


PROOF. The formula (x, ATy’> = (Ax, y^», valid for x € X and y' e Yf, 
shows at once that (A) c %{@(AT)}. The same formula shows that 
x € 9(Zi(AT)) implies (Ax, y'» = 0 for every y € Yf. But then x €.W(A) 
by Theorem 1.71-C. This completes the proof. 


Theorem I.9I-E. We always have 4&(AT)c (.W(4)9. We have 
R(AT) = {N (A) if AAT) is algebraically saturated. This is certainly 
the case if X is finite dimensional. 


PROOF. By Theorem 1.91-D we have (9(2(47)]9 = (/(4))9. Then 
(AT) — (.V(A))9, by Theorem 1.9-D. For the rest of the theorem we 
use the definition of “algebraically saturated" and Theorem 1.9-G. 


Theorem 1.91-F. If (AT) = X7, then A^! exists. 
PROOF. This follows by Theorem 1.91-D and (1.9-3). 


Theorem 1.91-G. Jf A-! exists, it follows that (922(AT))0 = Xf. If 
&(AT) is algebraically saturated (hence certainly if X is finite dimensional), 
we can conclude further that (AT) = Xf. 


PROOF. If A~! exists, (4) = (0). Then {9{#(AT)}}9 = (0)? = XY by 
Theorem 1.91-D and (1.9-1). The rest of the theorem follows at once 
(see Theorem 1.91—E). 

We emphasize that, if X is finite dimensional, 4-! exists if and only 
if R(AT) = Yr. 


PROBLEM 


If X is algebraically reflexive, so is X. Prove this without resort to questions 
of finite dimensionality, using the following suggestions: Let Jọ be the canonical 
mapping of X into X/^, J, the canonical mapping of X/ into Xf. By Theorem 
1.91—C, X is algebraically reflexive if and only if (J97)-! exists. By hypothesis 
(Ji) = XIS. Show that J,7! = Jo7, whence (Jo7)-? exists (= J1). 
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1.92 Conclusions 


The theorems of § 1.91 involve the ranges and null manifolds of the 
operator A and its transpose AT. If we suppose that the spaces X, Y 
and the operator 4 come to us as known things, the theorems will be 
effectively useful to us in furnishing information about A(A) and (A) 
only to the extent that we know or can find out the relevant information 
about @(AT) and.A/ (AT). For this, we must, at the very least, know some 
things about the spaces X/, Y/ and the operator AT. 

In the case in which X and Y are finite dimensional, the spaces X/ and 
Y/ are also finite dimensional. In this case the operator A is fully repre- 
sented by a matrix, and the transpose AT is represented by the transposed 
matrix. For the finite-dimensional case all the results of § 1.91 are well 
known in algebra (though perhaps in a different terminology) as part of 

~n the theory of systems of linear equations or of the theory of matrices. 

For infinite-dimensional spaces the results of $1.91 are not as useful 
as could be wished, because the algebraic conjugate of an infinite- 
dimensional space is not as amenable to study as the algebraic conjugate 
of a finite-dimensional space. The theory for finite-dimensional spaces 
is much simplified by the fact that we have simple “‘concrete represent- 
ations” of such spaces. If X is an n-dimensional linear space with real 
scalars, it is isomorphic to the arithmetic space R, (see the proof of 
Theorem 1.4—A), and we can regard R, as a concrete representation of X. 
Likewise, if A is a linear operator on X into Y (spaces of dimensions n 
and m respectively), we have a concrete representation of A by a certain 
m x n matrix. The purpose of such a representation is to replace one 
object of study by another object whose properties are more readily 
apparent because the structure of the object is more familiar or more 
susceptible to intuitive perception. 

In order to obtain results of the type presented in § 1.91, but more 
useful, it seems essential to abandon the purely algebraic approach to 
linear problems for infinite-dimensional spaces and to bring in topological 
considerations. If we impose a specified topological structure on a linear 
space X, it is natural to consider those linear functionals on X which are - 
continuous with respect to the topology. These form a subspace of the 
algebraic conjugate space X/; this subspace may be called the topological 
conjugate of X. Ina good many interesting special cases the topological 
conjugate of a given topological linear space X can be studied more 
effectively than the algebraic conjugate of X. This may be the case, for 
one thing, because the topological conjugate is significantly smaller than 
the algebraic conjugate (i.e., has fewer elements). It may also turn out 
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that there is a useful concrete representation of the topological conjugate 
space. Thus, for example, if X is the space of real-valued continuous 
functions defined on 0 < ż < 1, with a certain natural topology for X, 
the topological conjugate of X is isomorphic to a certain space whose 
elements form a subclass of the class of all real-valued functions of bounded 
variation defined on 0 < t < 1; see Theorem 4.32-C. 

This necessarily somewhat vague and general discussion is intended to 
suggest in part why the abstract approach to linear problems, as far as 
infinite-dimensional spaces are concerned, is more fruitful if suitable 
topological as well as algebraic methods are employed. There are still 
other reasons why it is useful to take account of a topology for a given 
linear space. A given linear operator may have important properties 
which find their appropriate expression in terms of the topological or 
metric notions of ‘‘nearness,” “small variations," and other related ideas. 

The greatest successes of the abstract approach to linear problems have 
been achieved in the study of Hilbert space. A Hilbert space is a very 
special type of linear space with a topology. It has many of the properties 
of Euclidean space and is, therefore, amenable to the use of geometric 
reasoning guided by intuition. But perhaps the decisive reason for the 
importance of Hilbert space, and for the greater success which has been 
achieved with Hilbert space than with other spaces, is the fact that the 
topological conjugate of a Hilbert space is isomorphic with the given 
Hilbert space. 
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TOPOLOGIES 


2.0 Scope of the Chapter 


This chapter is intended primarily for reference purposes. It contains 
the definitions and theorems relating to general topological matters which 
are needed at various places throughout the book. Since this is not a 
book on general topology, the selection of topics and the treatment of 
them conform to our primary interest in linear spaces. 

Although the reader is not presumed to have made an extensive study of 
abstract topology as a prerequisite for studying this book, some acquaint- 
ance with the ideas of abstract topology is needed. The student with some 
experience in topology should proceed directly to Chapter 3 after a pre- 
liminary scanning of Chapter 2. Thereafter he can refer back to Chapter 2 
as needed. The student who has never studied abstract general topology 
will probably find it best to read parts of Chapters 2 and 3 in close con- 
junction, paying especial attention to the examples in Chapter 3. It is not 
necessary to master all of these chapters before going on to later chapters. 


2.1 Topological Spaces 


The very general concept of a topological space has evolved by abstrac- - 
tion from various special situations; the original model for a topological 
56 
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space is the real axis, i.e., Euclidean 1-dimensional space. The basic 
notion in the general definition of a topological space is that of axioma- 
tizing the properties of open sets. A topological space is a set of elements 
in which certain subsets are designated as “open sets." The class of 
these open sets must satisfy certain axioms. 


Definition. A set X with a family 7 of subsets is called a topological 
space if 7 satisfies the following conditions: 


(a) The empty set Ø and the whole space X belong to 7 

(b) The union of any number of members of 7 (even uncountably many) 
is again a member of 7. 

(c) The intersection of any finite number of members of 7 is again a 
member of 7 


The family 7 is called a topology for X, and the members of 7 are called 
the open sets of X in this topology. 


Example I. If X is any nonempty set and 7 consists of € and X, 7 
is evidently a topology for X. 


Example 2. If X is any nonempty set and 7 consists of a// subsets of 
X ( and X are of course included), 7 is evidently a topology for X. It 
is called the discrete topology for X. 


` Example 3. Let X be the set of all real numbers x. A subset T of 
X will be called open if to each xo in T corresponds some A > 0 such that 
xeTif|x — xo| < h. Evidently X is open, and 9 satisfies vacuously the 
condition of being open. The axioms (a), (b), (c) for open sets are 
satisfied. The topology thus defined for X is the one regularly used in 
analysis. 


It is clear from Examples 1 and 2 that the general definition of a 
topology for a set X leaves the way open for situations quite different 
from those encountered in the customary topology of the real axis or of 
the Euclidean plane. 

A set S in the topological space X is called closed if its complement 
S’ is open. It will be seen that the empty set 0 and the whole space X 
are both open and closed. Because of the complementation rules, it 
follows that any intersection of closed sets is closed and that any finite 
union of closed sets is closed. Also, since (S') = S, a set is open if 
and only if its complement is closed. 

If S C X, the intersection of all closed subsets of X which contain S is 
called the closure of S and denoted by S. Clearly S is closed and S c S. 
Moreover, it is easy to see that S = Sif and only if S is closed. 
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If S € X, the union of all the open subsets of S is called the interior 
of S and denoted by int (S). Evidently int (S) is open and int (S) c S. 
Moreover, S is open if and only if S = int (S). 

The boundary of a set S is defined as the intersection of the closures of 
S and its complement S’. 

Any open set which contains a point x is called a neighborhood of x. 
Likewise, if S C X, an open set U such that S c U is called a neighbor- 
hood of S. 

A point x is called an accumulation point of a set S if every neighborhood 
of x contains a point of S distinct from x. It is not hard to see that a 
set S is closed if and only if it contains all its accumulation points. 

When we set out to construct a topology for a given set we often 
achieve this end by selecting certain sets which turn out to be open and 
which are used in determining all the other open sets. For example, in 
our definition of the topology of the real axis, in Example 3, we made 
use of the open intervals with a given point xo as center. This idea finds 
its general expression in the concept of a base. 

A family 3 of open sets is called a base at the point x if x € B whenever 
B € & and if to each neighborhood U of x corresponds some Be # such 
that Bc U. A family of open sets is called a base for the space X (or 
simply a base) if for each x € X there is a subfamily which is a base at x. 
A family & is thus a base for X if and only if to each x € X and each 
neighborhood U of x there is a set BE 9 such that xe B and BC U. 
The subfamily of all elements of 4 which are neighborhoods of x is then 
a base at x. Clearly the same family # cannot be a base for two different 
topologies on X. l 


Example 4. Consider the topology for the axis of real numbers 
defined in Example 3. The set of all open intervals of lengths 2/n (n = 1, 
2, +--+) is a base for this topological space, and the open intervals 
{x:|x — xo| < I/n] (n = 1, 2, -- -) form a base at Xp. 


If 4$ is a base for a topological space X, the following assertions are 
evidently true: 


(a) To each x € X corresponds some Be & such that x € B. 
(b) If B;, B; € 4 and x € B, N By, there exists some B, € $ such that 
xE Bi c (B, r^ Bj). 


Now let us suppose that X is a set, initially without any specified 
topology, and suppose that there is a family # of subsets of X satisfying 
the two conditions a, b just given. Let us then define a set S C X to be 
open if for each x e S there is some BEB with xe BCS. The class 
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J of open sets is a topology for X. The verification is easy. The empty 
set Ø is open, since it satisfies the condition vacuously. The set X is 
open, by (a). Condition (b) assures that finite intersections of open sets 
are open, and unions of open sets are seen to be open by the definition. 
The members of # are themselves open, according to the definition, and 
& is a base for the topological space X whose topology 7 was defined by 
means of 4. This illustrates an important method of introducing a 
topology on a set. 


Example 5. In R, (Example 1, § 1.2) let 2 be the family of sets B of 
the following sort: Choose an arbitrary point xo = (£,9, - - -, é?) and an 
arbitrary positive number r; let B be the set of points x = (1, ---, &,) 
such that (é — &,02 4... + (é, — £9)? < r?. This family 4 has the 
properties (a) and (b) mentioned in the preceding discussion; the topology 
for R, determined by 2 as a base in the standard topology for R,,. 


-9 Sometimes we consider several topologies for the same set X. If two 


topologies 7, and 7, for X are such that every member of .7 , is also a 
member of F, (i.e., 7, C 4 ;), we say that 7, is weaker than 7 ; and that 
J is stronger than .Z,. The stronger topology has more open sets. 
Other terminologies in this situation are: .Z is coarser than 7, and 7, 
is finer than 7; also, 7, is larger than F. 

If F is any nonempty family of topologies for X, the intersection of all 
these topologies is a topology for X, and it is weaker than all the topologies 
in F. Suppose that Z is any nonempty class of subsets of X. There 
certainly is a topology for X which includes the members of Z, namely 
the discrete topology for X. Hence there is a well-defined topology for 
X which is the intersection of all those topologies for X which include 
the members of «7. We call it the topology generated by £. The open 
sets in this topology are: Ø, Y, and all unions of finite intersections of 
members of.. The family æ is called a subbase for the topology which 
it generates. 

In our definition of a topological space there are no separation axioms. 
It can happen that, given two distinct points x1, x2, every neighborhood of 
xı contains xy. This implies that x, is an accumulation point of the set 
consisting of x, alone and, thus, that the latter set is not closed. There 
are various separation axioms that may be imposed on a topological 
space. One such axiom provides that, if x, and x, are distinct points, 
there exists an open set S, such that S, contains x, but not x». This is 
equivalent to the requirement that every set consisting of a single point 
be closed. 


Definition. A topological space is called a T,-space if each set 
consisting of a single point is closed. 
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A more stringent separation axiom requires that, if x, # x2, there shall 
exist open sets S4, S; such that x, € S4, x; € S2, and S1 O $; = Ø. Spaces 
with this property are called T;-spaces, or Hausdorff spaces. They are 
discussed in § 2.3. 


PROBLEMS 


l. If Sc X and xeX, xeS if and only if every neighborhood of x 
intersects S. 


2. A point x is in the boundary of a set S if and only if every neighborhood of 
x intersects both S and $’. 

3. A'set-5His open if and only if to each point x in S corresponds some neigh- 
borhood U of x such that U c S. 

4. The closure of a set consists of the set together with all its accumulation 
points. i 

5. If 2 is a base for X, every open set in X is the union of certain (perhaps 
uncountably many) members of the base. 


6. If 7 is the discrete topology for X (see Example 2), every subset of X is 
both open and closed. The discrete topology is stronger than every other 
topology. 

7. The weakest possible topology for X is that one in which consists solely 
of 0 and X. 


8. In the xy-plane let »& be the family of sets A of the following sort: Each 
A is determined by two distinct parallel lines and consists of all points of 
the xy-plane lying strictly between these two lines. What is the nature of the 
topology generated by y? In particular, how is this topology related to 
the topology defined in Example 5 if we regard the xy-plane as the space R2? 


2.11 Relative Topologies 


Suppose X is a topological space with topology 7, and let X, be a 
subset of XY. Then we can define a topology 7 for Xo by taking for 7 
the family of sets of the form TM Xo, where T c 7. The topology 79 is 
called the relative topology for Xo induced by (or inherited from) the 
topology J. 

When it is clear from the context in a certain situation that we are 
talking about the topology of X and the relative topology 7 for Xo, a 
subset of X, which is open (or closed) in the topology o is called relatively 
open (or relatively closed). A set S c Xy is relatively closed if and 
only if it is of the form AM Xo, where A is closed., For, S is relatively 
closed if and only if its complement relative to Xp is relatively open, 
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so that S itself must be of the form Xy — (T A Xo), where T is open. 
But 


Xo — (T Xy) = Xy (TA X9) = Xo (T'U Xo) 
= (Xo T)u (Xa N Xo) = Xo (A T'. 


Since 7” is closed, this shows that S has the form asserted. 

It is useful to observe that, if X; is a closed subset of X and if S c Xo 
is relatively closed, then S is closed in the topology of X. We can see 
the truth of this as follows: If Sc Xy, we have Xs © S', and hence 
Xo OS’ = Xy so that 


S' = (S'NA Xy) U (S'N X9 = Xo U (S'A X. 


But, if S is relatively closed, we have Xp — S = Xo N S' = TA Xo, where 
Tis open. Thus 


S = Xf U (TA Xo) = Xo UT, 


whence S’ is open (for Xo’ is open) and S is closed. 


2.12 Continuous Functions 


Let X and Y be topological spaces, and let f be a function with domain 
X and range Y. If S C X, we denote by /(S) the set of all f(x) e Y 
corresponding to x e S. If T c Y, we denote by f-!(T) the set of all 
x € X such that f(x) € T. There is no implication in this notation that 
an inverse function exists. 


Definition. The function f is said to be continuous at the point 
Xo € X if to each neighborhood V of f(xọ) in Y there corresponds a 
neighborhood U of x, in X such that /(U) € V. An equivalent rewording 
of this definition is convenient for some purposes: f'is continuous at xy if, 
for each neighborhood V of f(x,), the set f !(V) contains a neighborhood 
of xy. We further say that f is continuous on X if it is continuous at 
each point of X. 


Theorem 2.12-A. Suppose f is a function with domain X and range Y, 
where X and Y are topological spaces. Then f is continuous on X if and 
only if f- (V) is an open set in X whenever V is an open set in Y. 


PROOF, Suppose f-1(V) is open whenever V is open. Let xg be any 
point in X and V any neighborhood of /(xo). Then f^(V) is open and 
contains xy, so that /-!(V) is a neighborhood of xy. Thus fis continuous 
at Xo, by the second form of the definition. For the argument in the other 
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direction, suppose f is continuous on X, and let V be an open set in Y. 
Then, if x € - (V), V is a neighborhood of f(x), and hence f-1(V) must 
include a neighborhood of x. This implies that /-!(V) is open. 

If f has domain X and range Y and T € Y, it is easy to see that 


(2.12-1) SUT’) = (PUDY. 


From this formula and Theorem 2.12-A we see that f is continuous on X 
if and only if f (S) is a closed set in X whenever S is a closed set in Y. 

Sometimes we have the situation that X and Y are topological spaces 
and fis a function with domain Z(f) c X and range 4(f) c Y. In this 
case continuity of f at a point of Z( f) is defined by considering Z(f) and 
Af) as spaces with the relative topologies inherited from X and Y 
respectively. ^ 

Suppose that X and Y are topological spaces and that f is a function 
with domain X and range Y such that the inverse function f~! exists. If 
both f and /-! are continuous on their domains, f is called a homeo- 
morphism of X onto Y, and X and Y are said to be Aomeomorphic. 


2.2 Compact Sets 


Let X be a set, S a subset of X, and F a family of subsets of X such 
that each point of S belongs to at least one member of F. Then the family 
is said to cover S, or to be a covering of S. If X is a topological space 
and if all the sets in F are open, 7 is called an open covering of S. 


Definition. A subset S of a topological space Y is called compact 
if every open covering of S includes a finite subfamily which covers S. 


It is readily seen that S is compact as a subset of X if and only if S is 
compact when we consider S itself to be the whole space and use the 
relative topology. 

The empty set is compact. So is any finite set. 


Theorem 2.2-A. 4 set S € X is compact if and only if in every family 
of relatively closed subsets of S, the intersection of all of which is 0, there 
is a finite subfamily with this same property. 


PROOF. A family of relatively open sets covers S if and only if their 
complements (relative to S) form a family of relatively closed sets with 
intersection Ø. The theorem follows from this remark. 


Theorem 2.2-B. 4 closed subset of a compact space is compact. 
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PROOF. Let X be a compact space and S a closed subset of X. Let F 
be a family of relatively closed subsets of S whose intersection is Ø. If 
Fe, F is closed as a subset of X (this follows by an observation made 
in $2.11). Hence, by Theorem 2.2-A (applied to the compact set X), F 
includes a finite subfamily whose intersection is 0. Hence, again by 
Theorem 2.2-A, SS is compact. 


Theorem 2.2-C. Let f be a continuous function whose domain is 
compact. Then its range is also compact. 


PROOF. We can assume that the domain of fis all of X and the range is 
all of Y. If 7^ is a family of open sets V and if Y^ covers Y, the family 
U of sets U = f-1(V) certainly covers X. Moreover, each U is open, by 
Theorem 2.12-A. Since X is compact, 74 includes a finite subfamily 
U,,---, U, which covers X. The corresponding finite subfamily Vj, - - -, 
V,, clearly covers Y, and so Y is compact. 

We remind the reader that a point set on the real axis (or in n-dimensional 
Euclidean space) is compact if and only if it is closed and bounded. It 
follows from Theorem 2.2-C that, if f is real valued and continuous on a 
compact topological space, the values of f are bounded. Moreover, the 
set of values is closed, so that the function actually attains its least upper 
bound and its greatest lower bound. In other words, the function has a 
maximum value at some point of the space. and likewise a minimum value. 

Sometimes we consider sets S with the property that the closure S is 
compact. A set of this kind is called conditionally compact (or, also, 
relatively compact). 


2.21 Category. Separability 


Suppose X is a topological space. If S C X and S = Y, we say that 
S is dense in X. If the interior of S is empty, we say that S is nowhere 
dense. 


Definition. A set S C X is said to be of the first category if S is the 
union of a countable family of nowhere dense sets. If S is not of the 
first category, it is said to be of the second category. If S c X and x e X, 
we say that S is of the first category at x if there is a neighborhood U of 
x such that UNM S is of the first category; otherwise U N S is of the second 
category for every neighborhood U of x, and S is said to be of the second 
category at x. 


It can be verified that if S is of the first category it is of the first category 
at every point of X, and conversely. 
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Definition. A topological space X is called perfectly separable if there 
exists a countable family of sets forming a base for X (or, briefly, if X has 
a countable base). A space with a finite base will also be called perfectly 
separable. 

The Euclidean plane, for example, is perfectly separable. As a count- 
able base we may take the family of all interiors of circles with rational 
radii and rational coordinates for the centers. 

If the space X is perfectly separable, it contains an at most countable 
set S which is dense in X. In fact, if 2 is a finite or countable base for 
X and if S is a set formed by selecting one element from each of the sets 
in &, then S is at most countable and § = X. For, if we assume X — S 
to be nonempty, it is an open set containing some point x, and hence 
(since 4 is a base) there exists some BE 4 with xe Bc X — S. Some 
point of B must belong to S, however, and this is a contradiction, since 
BOS =9. 


Definition. A topological space X is called separable if there exists a 
finite or countable set S which is dense in X. 


The foregoing argument shows that a perfectly separable space is 
separable. The converse is not true in general, though it is true for 
certain types of spaces (e.g., metric spaces; see § 2.4). 

Some spaces, though not perfectly separable, have the property that 
at each point there is a countable base. The requirement that this be so 
is called the first axiom of countability. The requirement of perfect 
separability is called the second axiom of countability. 


2.3 Separation Axioms. Hausdorff Spaces 


In §2.1 we gave the definition of a T,-space: a topological space in 
which sets consisting of a single point are closed. We now define several 
other types of spaces, each of which is characterized by the addition of 
one or more separation axioms to the axioms for a topological space. 

Before stating these definitions we remark that two sets A, B are called 
disjoint if AA B = 9. 


Hausdorff Spaces. A topological space is called a Hausdorff space if 
for each pair of distinct points xı, x; in the space there exists disjoint 
neighborhoods U,, U, of x, and x, respectively. 


Regular Spaces. A topological space is called regular if for each point 
x and each closed set A not containing x there exists disjoint neighborhoods 
of x and A respectively. An equivalent formulation: For each point x 
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and each neighborhood U of x there exists a neighborhood V of x such 
that Vc U. 


Normal Spaces. A topological space is called normal if for each pair 
of disjoint closed sets 4, B there exist disjoint neighborhoods U, V of 
A and B respectively. 


Every Hausdorff space is a Tj-space, but some 7\-spaces are not 
Hausdorff spaces. A space can be regular or normal without being a 
T,-space. However, as applied to T,-spaces, the types Hausdorff, regular, 
normal, form a hierarchy: Every normal space is regular and every regular 
space is a Hausdorff space. There is a nomenclature according to which 
spaces are classified as T4, T5, T4, T4. The definitions for T5, T4, T, are 
as follows: 


T;-space: a Hausdorff space. 
T3-space: a regular Tj-space. 
T4-space: a normal 7;-space. 


The class of T-spaces is a proper subclass of the class of T-spaces. 
Likewise for T, and T3. 

Compact Hausdorff spaces of a rather general sort play an important 
role in certain parts of functional analysis. Nearly all of the topologies 
which are used in connection with linear spaces are such as to make the 
spaces regular; they are usually assumed to be 7\-spaces also, so that they 
are T3-spaces. 

Later on we shall need certain facts about Hausdorff spaces and normal 
spaces. We present these facts here as theorems. 


Theorem 2.3-A. If Cy and C, are disjoint compact sets in a Hausdorff 
space X, there exist disjoint neighborhoods Wo and W, of Cy and C, respect- 
ively. 


PROOF. We suppose at first that Co consists of a single point x, (such 
a set, in fact any finite set, is compact). Then for every point x in C, 
there exist disjoint neighborhoods U and V of xg and x respectively. The 
family of all the V's covers Cj, and hence some finite subfamily Vj, -- -, 
V, covers C}. Let U, ---, U, be the corresponding U's and let 
W = U,0.--0U, Wy =V,U---UV,. This gives what is wanted 
for this special case. In the general case suppose x is any point of Co. 
By what has just been proved there exist disjoint neighborhoods U, V of 
x and C, respectively. The family of all the U's covers Co, and hence 
some finite subfamily U;, ---, Um also covers Co. If Vi, +++, Vm are the 
corresponding V's, we let Wy = U,U--- U Um Wi Vin, 
and attain the desired result. 
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Theorem 2.3-B. 4 compact subset of a Hausdorff space is closed. 


PROOF. Suppose C is compact and x € C. Then x € C. For, if not, 
Theorem 2.3-A implies the existence of a neighborhood of x which doesn't 
intersect C. This in turn implies that x ¢ C (see $2.1). From this 
contradiction we conclude that C < C; hence C = C, and C is closed. 

A Hausdorff space is sometimes defined (as was originally done by 
Hausdorff) by a separate set of axioms. Let X be a set of elements, and 
suppose there is given a family VW of ordered pairs (N, x), where N is a 
subset of X and x € N, satisfying the following axioms: 


1. For each x € X there is at least one N C X such that (N, x) e M. 

2. If (N,, x) and (N,, x) are in “M, there exists an (N3, x) e ^ with 
Nc NON. 

3. If (Nj, xy) e. and x; € N,, there exists an N, € X such that 
(N5, X2) e VW and N, € Nj. 

4. If x, # xX, there exist sets Nj, Nz in X with (Nj, xj) and (No, x;) 
belonging to^, and N, O N; = 9. 


We now define a set S to be open if to each x e S there corresponds an 
element (N, x) e M with N c S. Axioms 1 and 2 guarantee that the open 
sets thus defined actually yield a topology for X. Axiom 3 assures us 
that all the sets N occurring in the elements of W are open. They evidently 
form a base for X. Finally, axiom 4 guarantees us that the space is a 
Hausdorff space. Conversely, a Hausdorff space satisfies axioms 1-4 
if we take for the elements of M all the pairs (U, x), where U is an open 
set containing x. 

There is a property called complete regularity which a topological space 
may possess and which is useful in the expression of certain ideas. 


Definition. A space X is called completely regular if for each xy € X 
and each neighborhood U of x, there can be defined on X a real-valued 
continuous function f, all of whose values lie on the closed interval 
[0, 1], such that /(xy) = 0 and f(x) = 1 ifxeX — U. 


A completely regular space is certainly regular. For, if x9, U, and f 
are as in the definition of complete regularity, the set {xi f(x) «iia 
neighborhood of xy whose closure lies in U. 

Every T,-space is completely regular. This fact is implied by the 
following more general result: 


Theorem 2.3-C. Let E and F be disjoint closed sets in a T4-space X. 
Then, there can be defined on X a real-valued continuous function f, all of 
whose POE lie on the closed interval [0, 1], such that f(x) = 0 if xe E 
and f(x) = lifxeF. 
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This theorem is commonly known as Urysohn’s lemma. We omit the 
proof in order to save space for other things. For proofs see Loomis, 
1, page 6, or Kelley, 1, page 115. 

We also observe the following: 


Theorem 2.3-D. 4 compact Hausdorff space is normal. 


PROOF. An immediate consequence of Theorems 2.3-A and 2.2- B. 


2.31 Locally Compact Spaces 


Definition. A topological space is called locally compact if every 
point has a neighborhood whose closure is compact. 


Any topological space X can be imbedded in another topological space 
Y, having just one more point than X, in such a way that Y is compact 
and the relative topology of X as a subset of Y is just the original topology 
of X. It is done in this way: Let yọ be any element distinct from the 
points of X. Let W be the class of open sets W in X such that W' is 
compact. Observe that Y € Y^. Let Y be the set consisting of the points 
of X and the point yọ. A set in Y will be called open if either (a) it does 
not contain yg and is open as a subset of Y, or (b) it does contain yy and 
its intersection with X is a member of W. These sets in Y meet the 
requirements for defining a topology; we leave verification to the 
reader. It is evident that the relative topology of X coincides with its 
original topology. 

Now Y is compact. For, supposing 7^ to be a family of open sets 
which covers Y, there must be some member of 7" of the form Wo U (vo). 
where W; € W. Then W,’ is compact as a subset of X. It is covered by 
the sets VA X, V varying over Y. Hence some finite set Vi VX, ---, 
Va O X covers Wy. ‘Then Vj, +e, V, and Wo U (yo) cover Y, so that 
Y is compact. E 

The space Y constructed in this way is called the one-point compactifica- 
tion of X. 

If X is a T,-space, so is Y. It can happen that Y is not a Hausdorff 
space, even though X is. However, if X is a locally compact Hausdorff 
space, Y will be a Hausdorff space. To verify that Y fulfills the 
Hausdorff separation condition in this case, it is enough to consider pairs 
of points of which one is yo, for, if both points are in X, the separation 
is accomplished by using the same sets as if we were dealing entirely with 
the space X. If x € X, there exists a neighborhood U of x such that Ü 
is compact. Then 0’ U (yo) is a neighborhood of yo which is disjoint 
from U, and the separation requirement is satisfied. 
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It is easy to see, conversely, that, if X and Y are both Hausdorff spaces, 
then X is locally compact. 


Theorem 2.31-A. Let X bea locally compact Hausdorff space, and let 
Co, C, be disjoint compact sets in X. Then, there exist disjoint neighbor- 
hoods Wọ and W, of Cy and C, respectively such that the closures of Wo 
and W, are compact. 


We state this theorem formally for later reference. Its proof differs 
but slightly from that of Theorem 2.3-A. One need only observe that, 
if U and V are neighborhoods of a point and V has compact closure, 
UN V is a neighborhood of the point having the same property. One 
can then make sure that all the neighborhoods obtained in the earlier 
proof have compact closures. 


Theorem 2.3l-B. Let X bea locally compact Hausdorff space. Let C 
be a compact set in X, and U a neighborhood of C. Then, there can be 
defined on X a real-valued continuous function f such that 0 < f(x) < 1 
for every x, f(x) = lif x eC, and f(x) = 0 if xe U’. 


PROOF. Let Y be the one-point compactification. of X, and in Y let 
E = U'U (yọ), F= C. Then E and F are disjoint closed sets in Y, and 
we can apply Theorem 2.3-C, since Y is normal. 


2.4 Metric Spaces 


If X is any set, we denote by X x X the set of all ordered pairs (x, x2), 
where x, and x; are in X. A function d with domain X x X and range 
in the real number field is called a distance function on X if it satisfies the 
conditions: 


(a) d(xi, x5) = d(x, x1). 

(b) d(xi, x3) € d(xi, x;) + d(x;, x3). 
(c) d(x;, x2) = 0 if and only if x, = x. 
(d) d(xi, x2) 2 0. 


A set X with a distance function is called a metric space. We note, 
incidentally, that (d) is a consequence of (a), (b), and (c) [put x; = x; in (b)]. 
The number d(x,, x2) is called the distance between x, and x,. Property 
(c) is called the triangular law of distances. 

With each point x9 in a metric space X and with each positive number 
r we associate the set of all x € X such that d(x, x9) < r. We call this 
set the sphere with center xg and radius r. In some spaces a sphere may 
contain no points other than the center. The set M of all pairs (N, x), 


F 
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where N is any sphere with center at x and x is any point of X, satisfies 
the four Hausdorff axioms (see $ 2.3) and thus defines a topology for the 
metric space, the set of all spheres being a base. The space is, moreover, 
a Hausdorff space. Whenever we speak of a metric space, it is understood 
that its topology is defined in this way. Verification that the four 
Hausdorff axioms are satisfied is left to the reader. 

A metric space has a countable base at each point (the set of spheres 
with positive rational radii and centers at the point). The space is 
perfectly separable if and only if there exists a finite or countable set which 
is dense in the space. We already know that such a set exists if the 
space is perfectly separable (see § 2.21). On the other hand, if we suppose 
that an at most countable set exists which is dense in the space, the set 
of all spheres with positive rational radii and centers at the points of this 
dense set provides a countable base for the space, as is readily verified. 
Thus, for a metric space, the notions of perfect separability and separability 
are equivalent. 

A sequence {x,} of points in a metric space X is called convergent if 
there is a point x € X such that d(x,, x) — 0 as n — oo; this x is unique if 
it exists. We then write x, — x and call x the /imit of the sequence. 


Theorem 2.4-A. In a metric space a set S is closed if and only if the 
situation: x, € S, x, — x implies that x € S. 


PROOF. If x, — x, where {x,} is a sequence in S, every neighborhood 
of x intersects S, and so xe S. If Sis closed, $ = S, and so xe S. On 
the other hand, suppose S has the property that x € S whenever x, — x 
and all the x, are in S. Choose any x e S. Then, for each n the sphere 
of center x and radius 1/n intersects S at least in one point, say x,. Then 
d(x, x) < l/n, and so x,— x, whence x € S. Thus Sc S, and S is 
closed. 


Theorem 2.4-B. Jn a metric space a point x is an accumulation point 
of a set S if and only if there exists a convergent sequence {x,} of distinct 
points of S with x as limit. 


The proof of this theorem is left to the reader. 

Sometimes a set X can be made into a metric space in different ways 
by different definitions of a distance function. For example, if X is the 
Xy-plane, any one of the expressions 


(x — a + (y — 8), 
[x — a| + |y — bl, 
max {|x — al, |y — bi} 
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can be taken as the definition of the distance between (x, y) and (a, b). 
It turns out that the topology for X determined by any one of these 
distance functions is the same as that determined by either of the others. 

If d, and d, are two distance functions on a set X and if 7, and 7, are 
the resulting topologies for X, it is easily proved that 7, = 7, if and 
only if, for all {x,}, d(x,, x) > 0 is equivalent to d»(x,, x) > 0. 

If X and Y are metric spaces and f is a function. with domain Z(f) in 
X and range &A(f) in Y, the topological definition of continuity (in § 2.12) 
is equivalent to the familiar ¢8-formulation of continuity: f is continuous 
at xo € Z(f) if to each e > 0 corresponds a 8 > 0 such that d( f(x), 
f(xg)) < e whenever x € Z(f) and d(x, xy) < 8. Here we have used the 
same symbol d for the distance functions in X and Y. Just as in classical 
analysis, we have the proposition: f is continuous at Xo if and only if 

f(x) > f(xo) whenever x, — Xo, (x,) being a sequence of points in Zf). 

The concept of uniform continuity can be defined for a function with 
domain and range in metric spaces: f is uniformly continuous on its 
domain if to each e > 0 there corresponds a ô > O such that a(/(xi), 

J (X2)) < « whenever x;, x; € Z(f) and d(xi, x2) < 8. 

"^ A subset S in a metric space X can be considered as a metric space by 
itself, using the same distance function as that defined on X, but confining 
attention to distances between pairs of points in S. The resulting 
topology of the metric space S is the same as the relative topology of S 
induced by the topology of X. 

A set in a metric space is called bounded if it is contained in some sphere. 


Theorem 2.4-C. Jna metric space a compact set is closed and bounded. 


PROOF. We already know that a compact set is closed, since a metric 
space is a Hausdorff space (see Theorem 2.3-B). Hence we have only to 
prove that a compact set is bounded. We may assume the set is nonempty. 
If the compact set is S and if x € S, let V, be the (open) sphere of center 
x and radius n. The family of all the V,'s covers S (in fact, covers the 
space) Since S is compact, a finite number of the V,'s suffice to cover 
S, and hence S € Vy for some index N. Thus S is bounded. 


Theorem 2.4-D. Jf S is a compact set in a topological space, every 
infinite subset of S has an accumulation point in S. 


PROOF. In this theorem the space need not be metric, nor even a 
Hausdorff space. Suppose T is an infinite subset of S but that T has no 
accumulation point in S. Then to each x € S there corresponds some 
neighborhood U of x which intersects T at most in the one point x (if x 
happens to be in T). The set of all these neighborhoods covers S, and 
. so a finite number of them, U,, ---, U,, suffice to cover S. Since 
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T € U U --- U U, and at most one point of T is in each U,, it follows 
that T is finite. This contradiction completes the proof. 


Theorem 2.4-E. 7f S is a subset of a metric space X with the property 
that every infinite subset of S has an accumulation point in ^ there exists 
a countable family “N of open sets in X such that, if U is any open set in 
X and x ESQ U, there is some set NE N for which x e N c U. 


PROOF. We assert that for each positive integer n there is some finite 


set of points xj, -- +, xy in S such that the set of spheres of radii 1/n: 
with centers at x), --+, xy covers S. For, if this were not so, there 
would be some n and a sequence of points x;, x2, --- in S such that 


d(x, x) 2 l/nif i z j. The infinite set of all these x's could not have 
any accumulation point, contrary to the hypothesis on S. Now let M 
be the countable family of all these finite sets of spheres. It is easy to 
see that this family has the property asserted for it. 


Theorem 2.4-F. 4 compact metric space is separable. 


PROOF. We see by Theorems 2.4-D and 2.4-E that, if the metric space 
X is compact, it has a countable base. 


Theorem 2.4-G. Jf S is a set in a metric space with the property that 
every infinite subset of S has an accumulation point in S, then S is compact. 


PROOF. Suppose Y is an open covering of S. Now, Theorem 2.4-E 
applies to S; hence let M be a countable family of open sets with the 
property specified in Theorem 2.4-E. Let M* be the subfamily of J^ 
defined as follows: N € M * if and only if N € M and there is some UE € 
with N c U. By the property of M and the fact that Y covers S, we see 
that * covers S. Now let %* be a subfamily of 4 obtained by taking 
from just one U such that N c U, foreach N € M*. Then 4* is at most 
countable, and it covers S. It remains to prove that some finite subfamily 
of 4/* covers S. Let the sets in 4/* be indexed: U;, U5,-... Suppose, 
contrary to what we wish to prove, that for each n the finite union 
U,U---UU, fails to cover S, so that there is some point x, e S — 
(U; U---U U,). The set of x,'s must be infinite, and hence must have 
an accumulation point, say xo, in S. Then x9 € Uy for some index N, 
and by Theorem 2.4-B x, € Uy for infinitely many values of n, in particular 
forsomen > N. This contradicts the fact that x, € S — (U,;U---U U,), 
and so the proof is complete. 

^. Theorems 2.4-D and 2.4-G together show us that, in a metric space, 
a set S is compact if and only if every infinite subset of S has an accumulation 
point in S. For many purposes the following criterion for compactness 
is convenient: 
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Theorem 2.4-H. Jn a metric space, a. set S is compact if and only if 
every sequence in S contains a convergent subsequence with limit in S. 


The proof of this theorem is left to the reader. 
Let S be a nonempty set in the metric space X, and let xo be any point 
in X. The distance between S and xg is denoted by d(S, x9) and defined as 


A(S, xo) = glb d(x, xo). 


If S, and S, are two nonempty sets in X, the distance between them is 
denoted by d(S,, S2) and defined as 


d(Si, S2) = glb d(xi, x2) (x1 € Si, x? € S2). 
Evidently d(S,, S2) = d(Sz, Sj). It is not difficult to see that 
(2.4-1) d(S;, S2) = gib d(S,, x) = glb d(S), x). 
xeS2 xe$i 


For any xo, d(x, xo) is a continuous function of x. For, it is readily 
seen by the properties of the distance function that 


|d(x, Xo) — d(x’, Xo)| < d(x, x’), 


whence the asserted continuity follows. It is also true that d(x,, x2) is a 
continuous function of both x; and x;. For, it may be seen that 


(2.4-2) [d(x, x") — d(xo, xo)| < A(x, xo) + AX’, xo). 


It follows from the continuity of d(x, x9) as a function of x that, if Sis 
a nonempty compact set, there is a point x € S such that d(S, x9) = d(x, xo) 
(see Theorem 2.2-C and the remarks following it). If S is a fixed non- 
empty set, then a(S, x) is a continuous function of x; we leave the proof 
. Of this to the reader. It follows that, if S; is any nonempty set and S; 
is a nonempty compact set, there is a point x? € S such that d(S;, $5) = 
d(S,,x;) Hence, if S; and S, are both compact, there exist points 
x, € S1, x; € S; such that d(S,, S2) = d(x, x;). A different proof of this 
last assertion can be made using Theorem 2.4-H, and we give this proof 
in the next paragraph to illustrate the convenience of the characterization 
of compact sets in the last mentioned theorem. 
If S, and S, are any nonempty sets, there exist sequences (x,'), (x,") 
in S; and S, respectively such that 


d(S,, S2) = lim d(x,', x,"). 


If S, is compact, {x,’} contains a convergent subsequence with limit 
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xi€ S, Let this subsequence be denoted by {y„}, and let the cor- 
responding subsequence of (x,") be denoted by {y,"}. Then 


dS); S2) = lim dyn, Yn). 


If S, is also compact, {y„"} contains a convergent subsequence with limit 
x2 € $,. Let this subsequence be denoted by {z,,”}, and let the correspond- 
ing subsequence of ( y,') be denoted by (z,'). Then z,' — X1, z," — X2, and 


d(Si, S2) = lim d(z,', Za) 


whence d(S1, S2) = d(x,, x2). 
V If d(S;, S2) > 0, it follows that Sı N S2 =Ø. The converse is not 
true, however, even if S, and S, are closed. For example, in the xy-plane, 
the sets S, = ((x, y):y > ex) and S; = ((x, y):y < 0} are closed and 
disjoint, and yet d(S,, S2) = 0. 

Suppose S is any nonempty set in a metric space. Then d(S, x) = 0 if 
and only if x € S, as is easily seen. This result can be generalized as 
follows: 


Theorem 2.4-1. Suppose that S,, S; are nonempty sets and that S; is 
compact. Then d(S,, S2) = 0 if and only if Š S; # 9. 


PROOF. As we saw previously, a(S), S2) = d(Si, x2), where x, is some 
point in S}. Thus d(S,..$,) = O implies d(S;, x;) = 0, which in turn 
implies x; € $}, so that 5; S, #9. Conversely, if x; € S, S,, it 
follows that d(S,, x.) = 0, and this implies d(S;, S2) = 0, by (2.4-1). 


Theorem 2.4-J. A metric space is normal. 


PROOF. Suppose S, and S, are nonempty closed sets in a metric space. 
For each point x € S, construct the sphere with center x and radius 
'/,d(S2, x). Let U, be the union of all such spheres as x varies over Sj. 
Likewise construct a set U2, related to S; as U, is related to S4. Then 
U, and U, are open, and clearly S, € U; (k = 1,2). It remains only to 
prove that U; O U, = Ø. Suppose that x € U, ÑN U2. Then, there exist 
points x, and x; in S, and S; respectively such that d(x, x1) < !/;(S5, x), 
d(x, x2) < 1/,d(S;, x2). Consequently, by the triangular law, 


(2.4-3) d(x, X3) < 4d(S>, xj) + 3a(Si, X2). 

Now 

Q4) — d($,x) «dx, x) and — (Sy, xj) < dixi, xj). 
Consequently, we see from (2.4-3) that d(S, xj) < d(S;, x;) and 
AS), x2) < d(S;, x,), whence d(S; x1) = d(S,, x;. But then (2.4-3) 
becomes d(x;, x2) < d(S,, x1), which contradicts (2.4-4). We conclude 
that U, ^ U, = Ø. Therefore the space is normal. 
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2.44 Completeness 


If X is a metric space and {x,} is a convergent sequence in X, with 
limit x, then d(x,, Xm) € d(x,, x) -- d(x, Xm), whence it follows that 
d(x,, Xm) > 0 as m— œ and n — œ. It can happen, however, that a 
sequence {x,} is such that d(x,, Xm) > 0 as m — oo and n — co, and yet 
the sequence has no limit. A sequence {x,} is called a Cauchy sequence if 
d(x,, Xm) — 0 as m and n — oo (i.e., if to each € > O corresponds an N 
such that d(x,, Xm) < € when N < m and N x n). 


Definition. If a metric space X has the property that every Cauchy 
sequence in X has a limit in X, then X is said to be complete. 

The property of completeness is very important in the construction of 
existence proofs. The fundamental difference between the fields of real 
and rational numbers, respectively, is that the real field is complete and 
the rational field is not when these fields are considered as metric spaces 
with d(xi, x2) = [x, — x»[ as the distance function. 


Definition. Two metric spaces X and Y are said to be isometric if 
there is a function f with domain X and range Y such that the inverse 
function /-! exists and furthermore such that d(x, x2) = d f(x), Ax) 
for every pair of points x,, x; € X. 


It is a fact of fundamental importance that an incomplete metric space 
can always be regarded as a dense subset in a complete metric space. 
The precise statement is as follows: 


Theorem 2.41-A. Let X be an incomplete metric space. There exists 
a complete metric space Y and a subset Yq dense in Y such that Yq and 
X are isometric. 


PROOF. Let {x,} and {x,'} be two Cauchy sequences in X. We write 
{x,} ~ (x,') and say that the two sequences are equivalent if d(x,, x,') — 0 
as n—» œ. Equivalence, thus defined, is reflexive, symmetric, and 
transitive, so that the set of all Cauchy sequences in X is divided into 
equivalence classes. We denote by Y the set of all these equivalence 
classes. We shall define a distance function on Y. 

First we observe that if {x,} and {x,’} are Cauchy sequences in X, 
d(x,, X,') is a Cauchy sequence of real numbers. For, by (2.4-2) 


|d(x,, Xn) E d(x,, Xm )| X d(x,, Xm) + Ax, Xm) 


whence we see the truth of the assertion just made. Next we assert that 
lim d(x,, x,') (which exists, since the real numbers form a complete space) 
n>% 


$2.4] TOPOLOGIES 75 


is unchanged if we replace (x,) by any equivalent Cauchy sequence, and 
likewise with (x,'). This is because, if {x,} ~ {a,} and (x,') ~ {a,’}, 


Id(x,, Xp") — dap, a,)| < d(x,, a,) + AX, a). 


We leave the rest of this argument to the reader. Now, if y, y' € Y, let 

íx,) and {x,’} be Cauchy sequences from the equivalence classes y, y' 

respectively. We define d(y, y’) = lim d(x,, Xn). By what has been said, 
no 


, 


this limit exists and is uniquely determined by y, y'. It is not hard to 
show that the function d thus defined on Y x Y is a distance function, so 
that Y is a metric space. We leave these details to the reader. 

Let Y, be the subset of Y consisting of those equivalence classes. which 
contain a Cauchy sequence (x,) for which xı = x; =x;=---. There 
cannot be two different Cauchy sequences of this kind in the same equi- 
valence class. If y, y' € Yo and if corresponding Cauchy sequences are 
{x,} and {x,’}, with x, = x, x,’ = x’ for every n, we see that d(y, y) = 
d(x, x). It is then clear that Yọ and X are isometric. Next we show 
that Yo = Ý.. If y € Y, let {x,} be a Cauchy sequence from the class y, 
and suppose e > 0. There exists an integer N such that d(x,, xy) < e/2 
if N<n. Let yo € Yo be the class containing the repetitive sequence 
Xy, Xn, +++. Then d(y, yo) = lim d(x,, xy) € €/2 < e. This shows that 

no 


y € Ys, and hence that Y — Y,. 

Finally, we show that Y is complete. Suppose {y,} is a Cauchy 
sequence in Y. For each n choose z, € Y, so that d(y,, z,) < I/n ; we 
can do this since Y, is dense in Y. Now 


d(z,, Zm) € d(z,, Vn) + dO Ym) + dr Zm) 


1 1 
< n + m + d(ys. Ym) 


and so {z,} is a Cauchy sequence. Let x, be the element in X which is 
matched with z, in the isometric correspondence between X and Yọ. 
Then {x,} is a Cauchy sequence in X. Accordingly, there is a unique 
equivalence class y € Y which contains {x,}. Now 


1 
dy, y) S dy, Zn) + dz, y) < z + do Y), 


and since d(z,, y) = lim d(x,, Xm), it is clear that y, — y. This proves 


that Y is complete and finishes the proof of the theorem. 
In practice we identify X with Yo and regard X as a dense set in Y. 
The space Y is called the completion of X. We can, if we choose, adjoin 
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the elements of Y — Y, to X and form a space isometric to Y in which Y 
is genuinely a denseset. When this is done we shall denote the completion 
of X by X. ; 

A nonempty set S in a metric space is said to have finite diameter if 
d(x, x') is bounded as x and x’ vary over S. The diameter of S is then 
defined as the least upper bound of the distances d(x, x’). We denote 
the diameter of S by diam (S). A nonempty set has finite diameter if and 
only if it is bounded. 


7; Theorem 2.41-B. Let X be a complete metric space. Suppose (S,) is 
a sequence of nonempty closed sets in X such that S, > S, > S42 ..- and 
such that diam(S,) — 0 as n— oo. Then the intersection of all the sets 
S, is nonempty. 


PROOF. This theorem is commoniy known as Cantor’s intersection 
theorem. To prove the theorem, choose a point x, € S, for each n. If 
m <n, X, and x, are both in S, and so d(x,, x,,) < diam(S,,). Thus 
{x,} is a Cauchy sequence, and, since X is complete, the sequence has a 
limit x in XY. It is a simple matter to prove that x € Sm for every m. We 
leave the completion of the proof to the reader. 


Theorem 2.41-C. Let X be a nonempty complete metric space. Then 
X is of the second category as a subset of itself. Moreover, X is of the 
second category at every one of its points. 


PROOF. We shall refer to this theorem, and especially to the first 
assertion in the theorem, as Baire's category theorem. If xy € X and 
r > 0, let us write K(xo, r) = {x:d(x, xy) < r}. This.set is closed; we 
call it the closed sphere with center xg and radius r. The set (x:d(x, Xo) 
< r}, which we have previously called the sphere of center x, and radius 
r, may for emphasis be referred to as an open sphere. It is clear that any 
open sphere with center x9 contains a closed sphere with the same center, 
and vice versa. : 

Now suppose that X is of the first category, so that X is the union of 
nowhere dense sets S,, S2, S3, --.. The fact that S, is nowhere dense 
can be expressed by the siatement that any closed sphere contains another 
closed sphere which does not intersect S,. Hence we see by induction 
that there exists a sequence of closed spheres K, — K(x,, r,) such that 
K,018,—0, O«r, « l/n, and Ku © K, Now diam(K,) < 2/n; 
hence we can apply Cantor's intersection theorem to assert that there 
exists a point x in the intersection of all the closed spheres K,. But then 
x is not in any S, and hence not in X, which is a contradiction. Therefore 
X is of the second category. 
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To prove the second assertion in the theorem, suppose some point 
xex has a neighborhood V which is of the first category, so that 


V= U S,, where S, is nowhere dense. Let K be a nonempty closed 
n=] 


sphere contained in V. Then (see Theorem 2.41-E) K in itself is a 


[se] 
complete metric space. Now K — U (S, K). It is easily verified 
n=l 
that S, © K is nowhere dense in K, and hence K is of the first category in 
itself, contrary to the fact that it is a complete space. This contradiction 
' completes the proof. 
The next theorem has applications in the study of linear operators, 
as well as elsewhere in analysis. 


Theorem 2.41-D. | Let X be a metric space and S a set of the second 
category in X. Let F be a family (f) of real-valued, continuous functions 
defined on X such that for each x € S there exists a real number m(x) with 
the property that f(x) < m(x) for every f € F. Then, there exists a real 
constant N and an open sphere K in X such that f(x) < Nif xe Kandfe F. 


PROOF. For each positive integer n let S, = (x:f(x) < n when fe F}. 
The continuity of f insures that S, is closed. The condition on S and F 


insures that S c U S, Let T, = SAS, Then T,c S, = S,, and 
e n=1 

S= U T,. Since S is of the second category, at least one of the sets 
n=l 

T,, say Ty, is sich that Ty contains a nonempty open set and hence 

contains an open sphere, say K. Then KS Sy. This means that 

f(x) < NifxeKandfeF. The proof is now complete. 


Theorem 2.41-E. Let X be a complete metric space, and Xo a closed 
set in X. Then Xo, considered as a metric space by itself, is complete. 


The proof is left to the reader. 


Theorem 2.41-F. Let S be a compact set in a metric space. Then S, 
considered as a metric space by itself, is complete. 


The proof is left to the reader. Use Theorem 2.4-H. 

Suppose that S is a set in the metric space X, and let X be the completion 
of X. If we regard S by itself as a metric space, the completion of S, 
denoted by S, can be identified with a subset of X, and we shall suppose 
this to be done. If § is the closure of S in X, it is easily seen that 
Š= $n X. The closure of S in Á is $. 
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Definition. A set S is called precompact if $ is compact. 


It is readily seen that S and S have the same closure in X, and therefore 
the same completion. If S is conditionally compact (see § 2.2), i.e., if 5 
is compact, then S is complete, and so coincides with its completion $. 
Hence a conditionally compact set is precompact. If the space X is 
complete, S coincides with $. Hence in this case (but not in general) a 
precompact set is conditionally compact. 


Theorem 2.41-G. 4 nonempty set S in a metric space X is precompact 
if and only if to each « > 0 corresponds some finite set x,, - - -, x, of points 
of X such that S is contained in the union of the spheres of radius e with 
centers at Xy, >>>, x 


n* 


PROOF. If x, € X, the sphere in ¥ with center x, and radius « intersects 
X in the sphere in X with center xo and radius e. Consider the set . of 
all spheres in X with centers in S, each sphere of radius e > 0. If 
x € $, the sphere in ¥ of radius e and center x will contain some point 
y € S, and hence the sphere in ¥ of center y and radius « will contain 
x. Thus F covers $. Assuming now that $ is compact, we conclude 
that a finite number of the members of F suffice to cover $. Hence 
the intersections of these spheres with X cover S. Thus one half of the 
theorem is proved. Note that the centers of the spheres can be taken 
in S. 

Now let us assume that S has the property stated in the theorem, and 
let us prove that $ is compact. First we shall show that every sequence 
of elements from S contains a Cauchy subsequence. Starting with a 
given sequence {x,}, we know that there exists a finite number of spheres 
in X of radius 1, with centers in X, whose union contains S; therefore, 
some one of these spheres must contain a subsequence from {x,}. Denote 
this subsequence by xii, X12, X13, -- .. Next we consider spheres of 
radius 4, and conclude that some sphere of radius 4 must contain a 
"subsequence of the foregoing subsequence. We proceed by induction, 


obtaining sequences X41, X45, X43, °° "s (k = 1, 2, -- -;) each a subsequence 
of its predecessor, and the Ath sequence contained in a sphere of radius 
1/k. The diagonal sequence x11, X22, X33, ^: is then a Cauchy sequence 


and a subsequence of the original sequence {x,}. Now consider a 
sequence {y,} from Í. Since $ is closed in € and X is complete, $ will 
be proved compact if we show that {y,} contains a Cauchy sequence. 
Now, there exists a point x, € S such that d(x,, Ya) < 1/n. The sequence 
{x,} contains a Cauchy subsequence (x,u45j, and the corresponding 
subsequence (y,45) will also have the Cauchy property, as is readily seen 
by the triangular inequality. Thus the proof is complete. 
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2.5 Product Spaces 


If X and Y are nonempty sets, the Cartesian product set X x Y is by 
definition the set of all ordered pairs (x, y), where x e X and ye Y. If 
X and Y are topological spaces, there is a standard method of assigning 
a topology to X x Y. Let £ be the family of subsets of X x Y of the 
form U x V, where U and V are any nonempty open sets in X and Y 
respectively. Then, we take as the standard topology of X x Y the 
topology generated by . (see $2.1). The open sets in X x Y are thus 
Ø and unions of members of «7. This definition extends in an obvious 
manner to products X, x --- x X, of a finite number of topological 
spaces. 

It is sometimes necessary to define the Cartesian product of an infinite 
number of topological spaces. This is done as follows. Let J be an index 


set and (X;) (ie I) a family of sets. The product set X = Im X; is by 
iel 

definition the set of all functions x with domain J and range U X; such 
i iel 

that the value of x at i [denoted by x(i)] is in X;. This definition is 

- consistent with the one already given if J is a finite set. If each X; is a 


topological space, let x be the family of product sets of the form lI Si, 
iel 

where for some finite subset of the indices i, S; is an arbitrary nonempty 
open set in X;, and S; = X; for the rest of the indices. The topology of 
X is then taken to be that generated by £, and with this topology X is 
called the Cartesian product of the Y;. 

If x € X, the value x(i) is called the coordinate of x in X;. Let f, be 
the function with domain X and range X; defined by f(x) = x(i). If (for 


a fixed i) T; is an open set in X;, f," !(T;) is the product set li S; in which 
Jel 

S; = T, and S, = X; ifj # i. This set is open in X, and so f; is con- 

tinuous. Actually, it can be shown that the topology we have assigned to 

X is the weakest topology such that all the functions f; are continuous. 

If S is a set in X, the set f,(S) is called the projection of S onto X;. 

It is easily seen that if all the spaces X; are Hausdorff spaces, their 
Cartesian product is also a Hausdorff space. 

Suppose for a moment that 7 is the finite set of integers 1, ---, n. Let 
us write x(i) = x, The value f(x) of a function defined on X is often 
Written f(x,, --+, x,). If the values of f are in a topological space Y, 
J is continuous at a = (a, - - +, a,) if and only if to each neighborhood V 


80 INTRODUCTION TO FUNCTIONAL ANALYSIS [$2.5 


of f(a,, +--+, @,) there correspond neighborhoods U;, ---, Un of a, --+, 
a, in X1, -, Xn, respectively, such that f(x,,---, Xa € Vif x; € Uy, 
X4, € Up 

If X, .-., X, is a finite set of metric spaces, the product set 
X= X, x +--+: x X, can be made into a metric space in a number of 
ways. For example, if x = (xj, -+-, x,) and a = (a, * - *, a,) are points 
of X, we can define 


d(x, a) = doy, à) + +++ + dx, a), 


where d; is the distance function in X;. Other workable definitions of 
distance in X are 
d(x,a) = max d,(x;, aj) 
I<ign 
and 
d(x, a) = [(diG, a,)}? + aa + {d,(Xn» a)y È. 


All three of these definitions of distance yield the same topology for X, 
and it is the same as the topology of the Cartesian product. 

Later on in the book we shall need the following theorem, due to 
Tychonoff: 


Theorem 2.5-A. The Cartesian product of compact spaces is compact. 


For reasons of space we omit the proof of Theorem 2.5-A. For proofs 
we refer to Loomis, 1, page 11, and Kelley, 1, page 143. 
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TOPOLOGICAL 
LINEAR SPACES 


3.0 Introduction 


The concept of a topological linear space is the result of combining in 
a suitable way the concept of a linear space and the concept of a topological 
space. The phrase "in a suitable way” means that we set up a certain re- 
lation between two concepts. The essence of this relation is that we require 
the topology of the space to be such that the algebraic operations native to 
the linear space are continuous as functions of the elements which enter 
into these operations. We state this requirement more precisely as follows: 


Definition. Let Y be a linear space which is also a topological space 
in the sense of $2.1. Let A be the space of scalars associated with Y, 
with its usual topology (that of the real or complex number system). 
Then x, 4- x; is a function defined on the product space X x X and ax 
is a function defined on A x X. We say that X is a topological linear space 
if x, + x; is a continuous function on X x X and ax is a continuous 
function on 4 x X. The product spaces are given the usual topologies 
for Cartesian products (see $2.5). 


Purely from a logical point of view it might be appropriate to begin 
our consideration of topological linear spaces with a study of general 
8l 
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features common to all such spaces. We might then proceed to classify 
topological linear spaces in some way and to.study the various classifica- 
tions in some order determined by a scheme of progressive specialization. 
Our procedure will be quite different from this. We shall begin with 
consideration of normed linear spaces. These are spaces in which the 
topology is introduced, by means of a metric, in a simple and natural way 
by assuming that each vector in the linear space has a length and that the 
rules governing the lengths of vectors conform to a few simple and natural 
geometrical principles. Most of the later part of this book is concerned 
with the use of normed linear spaces in functional analysis. Some 
knowledge of topological linear spaces of more general type is advanta- 
geous, even if one restricts his attention mainly to normed linear spaces. 
On this account we have given some attention to the general fundamental ` 
notions about topological linear spaces in the latter half of this chapter. 
In particular, the study of convex sets is made in the context of general 
topological linear spaces. A good deal of this material is of importance 
for applications in connection with normed linear spaces, but for various 
reasons it seems better to present it in the general form as part of the 
theory of topological linear spaces. The reader who is interested mainly 
in normed linear spaces need not have an extensive knowledge of the more 
general theory in order to get what he needs out of §§ 3.4-3.7. The 
general form of the Hahn-Banach theorem is given as Theorem 3.7-B. 
The special form of it needed in normed linear spaces occurs in Chapter 4 
as Theorem 4.3-A. For locally convex topological linear spaces the 
appropriate form is that of Theorem 3.8-D. 

Kolmogoroff's criterion for normability of a topological linear space 
is given in Theorem 3.41-D. In $ 3.81 are given some of the fundamental 
notions about weak topologies for linear spaces. The main use of these 
ideas in the book is in connection with normed linear spaces (see 
especially, 88 4.41, 4.61, 4.62). 

Of especial interest among normed linear spaces are the inner-product 
spaces, in which the length, or norm, of a vector is defined in terms of 
a certain function of two vectors, called the inner product. If the vectors 
are x, y, the inner product is denoted by (x, y). It is formally analogous 
to the dot product of ordinary vector analysis; in fact, an n-dimensional real 
inner-product space is congruent to the Euclidean space R,, in which the 
inner product (= dot product) of x = (é, ---, £) and y = (m, +--+, 7,) is 


(x, y) = Em pasce En 


The relation of the norm to the inner product is that expressed in the 
formula 
lx] = (x, x}. 


§ 3.1] TOPOLOGICAL LINEAR SPACES 83 
For R,, this gives 
(Ix = (X2 +--+ + ADS 


this is the usual expression for the length of x in Euclidean geometry. 

A complete, infinite-dimensional inner-product space is called a Hilbert 
space. The name is in honor of David Hilbert, who studied a particular 
space of this sort in connection with his investigations of the theory of 
integral equations. 

In some of those sections in this chapter where there are a great many 
theorems, a statement will be found early in the section calling attention 
to the principal theorems. 


3.1 Normed Linear Spaces 


A norm on a linear space X is a real-valued function, whose value at 
x we denote by ||x||, with the properties: 


(a) [lx + xal < lxil] + lz. 
(b) |laxi| = |æ] ixl]. 

(c) lix] > 0. 

(d) ||x|| 4 0 if x # 0. 


Actually, property (c) is a consequence of properties (a) and (b). For j0jj = 
0 by (b) (put œ = 0), and from (a) and (b) 0 = |x — xl] < |x|] + ||- xij = 
2ilxj, whence 0 x ||x|J. 

A linear space on which a norm is defined becomes a metric space if 
we define d(x;, x2) = |x, — xj], as is easily verified. A linear space 
which is a metric space in this way is called a normed linear space, or a 
normed vector space. If we regard x as a vector, its length is ||x|; the 
length |ix, — x,|| of the vector difference x, — x? is the distance between 
the end points of the vectors x, X2. 

If f is a function with domain Z(f) € X and range Af) c Y, where 
X and Y are normed linear spaces, continuity of f at xo € Z(f) is expressed 
by the condition: to each « > 0 corresponds some 6 > O such that 
f(x) — fx] < eif x e 2(f) and [jx — xol] < 8. 

The set {x:||x — xoll < r}, where r > 0, is the (open) sphere of radius 
r with center xo; the closure of this set is {x:||x — xol] < r}, which we call 
the closed sphere of radius r with center xy. By the surface of this sphere 
we mean the set (x:|x — xgl| = r}. 

A set S in a normed linear space is bounded if and only if it is contained 
in some sphere; an equivalent condition is that S be contained in some 
sphere with center at 0, which means that ||x|| is bounded for x e€ S. 
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The field of scalars associated with a normed linear space may be either 
the real field or the complex field, and the space itself is called real or 
complex according to which of these scalar fields is used. Definitions and 
theorems in which no particular specification is made concerning the scalar 
field are applicable to both real and complex spaces. 

We make free use of the definitions and terminology concerning linear 
spaces as given in Chapter 1. A subspace of a normed linear space is 
itself a normed linear space. However, a subspace of a normed linear 
space may or may not be closed, and the distinction between closed and 
nonclosed subspaces is often important. The terms subspace and linear 
manifold are used interchangeably. Í 

A linear space can be a metric space without being a normed linear 
space. Also, a linear space can have a topology and yet not be a metric 
space. 

Let X be a normed linear space and let A denote the scalar field 
associated with X (either the real or the complex field). We observe that 
A itself is a normed linear space, with the absolute value as norm. Vector 
addition in X is a function on the Cartesian product X x X. This 
function is continuous, as we see from the inequality 


lxi + x3) — Qu t y» «€ Iba — yall + leo — yall. 


Multiplication of vectors by scalars isa function on.4 x X. This function 
is continuous, as we see from the relations 


ex — egxoll = ilex — xo) + (æ — ey)xoll 
< |e| lx — xoll + |e — «ol loll. 

As a result of the continuity of x, + x; and ox, it is easy to see that, if 
M is a linear manifold in X, the closure M is also a linear manifold. If 
S is any set in X, the closure in X of the linear manifold generated by S 
(as defined in § 1.1) is called the closed linear manifold generated hy S. 
The word “generated”? in this definition is sometimes replaced by 
** determined"! or “spanned.” 

It is also to be observed that ||x|| is a continuous function of x. This 
follows from the inequality 


| all — ibeall | < lix. — all 
which follows easily from property (a) of the norm. 
Definition. Two normed linear spaces X and Y are said to be iso- 
metrically isomorphic or, more briefly, congruent, if there is a one-to-one 
. correspondence between the elements of X and Y which makes the two 


spaces isomorphic in the sense defined in $ 1.4 and isometric in the sense 
defined in § 2.41. 
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In order that X and Y be congruent it is necessary and sufficient that 
there exist a linear operator T with domain X and range Y, such that 
T-1 exists and ||Tx|| = ||x|| for every x e X. Here we use the same symbol 
for the norm in X as for the norm in Y. We shall meet examples of 
congruent spaces when we deal with concrete representations of various 
linear spaces whose elements are linear operators. 


Definition. Two normed linear spaces X and Y are said to be 
topologically isomorphic if there is a linear operator T (with inverse T-1) 
which establishes the isomorphism of X and Y and which furthermore 
has the property that T and T-! are continuous on their respective domains. 
In other words, X and Y are topologically isomorphic provided there is 
a homeomorphism T of X onto Y which is also a linear operator. For 
this reason X and Y may be called /inearly homeomorphic. 

As we see later, there exist examples of pairs of spaces which are 
topologically isomorphic but not congruent. 

It is convenient at this point to consider a few facts about continuous 
linear operators in normed linear spaces. Linear operators, without 
regard to continuity, were defined in $ 1.3. 


Theorem 3.1-A. Let X and Y be normed linear spaces and T a linear 
operator on X into Y. Then T is continuous either at every point of X or 
at no point of X. It is continuous on X if and only if there is a constant 
M such that ||Tx|| < M|xl| for every x in X. 

no 


PROOF, let xo and x, be any points of X, and suppose T is continuous 
at xg. Then to each « > 0 corresponds ô > 0 dich that Tx — Txgl| < € 
if |x — xoll < 8. Now suppose |x — xıl < 9. Then [(x + x9 — xi) 
— xoll < 8, and $6 ]|T(x + xo — xi) — Txoll < e. But T(x + xo — xi) 
— Tx, = Tx — Tx,, and so ||Tx — Txill < «. This shows that, if T is 
continuous at Xp, it is alsó continuous at x,; thus, the first assertion of 
the theorem is proved. 

If ||Txj| < M ||x|| for all x, it is clear that T is continuous at O [recall 
that 7(0) = 0]. Conversely, if T is continuous at 0, ||7x|| can be kept 
as small as we please by keeping x sufficiently small. Thus, in particular, 
there is some 5 > 0 such that |[Tx|| < 1 if |x| < 9. Now, if x Æ 0, let 
Xo = (&x)/Qlxl), so that [xoll = 9/2 < 8. Then ||Txo| < 1. But 
Txo = [8/(2|Ixl)] Tx, and so 
2iixi 

è 
Thus, if we take M = 2/8, we have ||Tx| < Milxi| if x # 0, and this 
inequality evidently is true as well when x = 0. The proof is thus 
complete. 


rx = ZEI preg) < Sp. 
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If |Tx|| < Milx|| for every x, it is plain that ||Tx| < M when ||xl| < 1 
Vice versa, if ||Txl| < M for every x such that ||x|| < 1 (or even for every 
x such that |x|| = 1), then ||Tx|| < Mi[xl| for every x. This is proved by 
an argument like that used in the last part of the foregoing proof. The 
smallest admissible value of M in the inequality ||Tx| < M||x|| is called 
the bound of T. Itis also called the norm of T and denoted by ||T!|. The 
reason for this terminology and notation will appear later. The following 
formulas for the norm of T are useful: 


(3.1-1) ITI = sup, Txi, 

(3.1-2) ITI = sup ITxl, 
Z sup IZI, 

(3.1-3) |T'|| SUP Til ET 


For (3.1-2) and (3.1-3) we assume, of course, that X contains some x 
such that x # 0. 

When T is a continuous linear operator on X into Y, it is clear from 
Theorem 3.1-A that a set S lying in the sphere ||x/| < rin X is carried into 
the set T(S) lying in the sphere || y!| < |Z| in Y. Hence T(S) is bounded 
if S is bounded. Conversely, if T is linear and has the property that 
T(S) is a bounded set whenever S is a bounded set, it follows that T is 
continuous. We leave verification of this assertion to the reader. 


Theorem 3.1-B. Suppose T is a linear operator on X to Y, where X 
and Y are normed linear spaces. Then, the inverse T^! exists and is 
continuous on"its domain of definition if and only if there exists a constant 
m > 0 such that 


(3.1-4) ; m||x|| < ||Tl| 
for every x € X. 


PROOF. If (3.1-4) holds and Tx = 0, it follows that x = 0. Then 
T-! exists, by Theorem 1.3-B. Now y = Tx is equivalent to x = T-1y. 


Hence (3.1-4) is equivalent to m|7-1y| < i|yll, or |T-1y|| < - Iyi, for all 


y in the range of T, which is the domain of T-1. This implies that T~! is 
continuous, by Theorem 3.1-A. We leave the converse proof to the reader. 


Theorem 3.I-C. Jf X and Y are normed linear spaces, they are 
topologically isomorphic if and only if there exists a linear operator T with 
domain X and range Y, and positive constants m, M such that 


(3.1-5) m|ixi < ||Txl| < Milxil 
for every x in X. 
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PROOF. This theorem is a direct corollary of Theorems 3.1-A and 
3.1-B--- 


Theorem 3.1-D. Let X be a linear space, and suppose two norms |x| 
and |xl|, are defined on X. These norms define the šamie topology on X if 
and only if there exist positive constants m, M such that 


(3.1-6) mlll < ixi» < MI 
for every x in X. 


PROOF, Let X; be the normed linear space which X becomes with the 
norm [ix|; (à = 1, 2). Let Tx = x, and consider T as an operator with 
domain X; and range Y;. Condition (3.1-6) is precisely the condition 
that T and T-! both be continuous. They are both continuous if and only 
if the open sets in X, are the same as the open sets in X? (Theorem 2.12-A). 
The conclusion now follows. 


Ai LEN, 

.3.11 Examples of Normed Linear Spaces 

In this section we define and establish standard notations for a number 
of spaces which will be referred to at various places throughout the book. 
In defining the norms in these various spaces we frequently leave it for 
the reader to verify that the norm, as defined, actually has the properties 
required of a norm. 

In many of our examples, the elements of the spaces are functions 
defined on some set T. The values of the functions may be either real 
or complex; we get a real or complex space according to whether the 
values of the functions are real or complex. It is always to be understood 
that, if x4, x; and x are functions defined on T, the functions x; + x; 
and ox are defined by 


(x1 + xX = x,(t) + x(t), (ax)(t) = ex(t), teT. 


Example l. The spaces R, and C, (defined in Examples 1 and 2, 
§ 1.2) can be made into normed linear spaces in a variety of ways. Let us 
consider C,. If x = (é,---, £) € C, and p > 1, let us define 


G.11-1) lil = (£o + +++ + dedo. 


The triangularity property |x; + xjll < llxil| + [lx2|| is the same as 
Minkowski’s inequality for finite sums, namely 


n 1/p n 1/p n l/p 
(> lé; + ni) < (> ir) + (> nl) 
f=] i-l i=] 


` 
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For reference to Minkowski's inequality see the Introduction. When C, 
is considered as a normed linear space with the norm (3.11-1), we denote 
the space by /p(n). We can make the real space R, into a normed space 
in the same way. We shall use X(n) for both the real and the complex 
space with norm (3.11-1); whether the real or complex space is under 
discussion at a given time will either be clear from the context, or we 
shall make a specific statement if necessary. 
We can also define a norm in R, and C, by the formula 


ixi] = max [léi] ++ +> [é]. 


The notation for the space with this norm is /*(m). This notation is 
natural, since 


(3.11-2) max \é,| = lim (ée +--+ + JEJA. 


Example 2. We also have spaces analogous to Ir(n) and /e(n) for 
infinite sequences. The space /?, where p > 1, is defined to consist of all 


sequences x = {é,} such that > £l? < ov. The norm in F is defined by 


n=t 


. eo lp 
Q.11-3) ixil = (> er a 


-1 


Minkowski's inequality for infinite sums is used in showing that the 
requisite properties of a norm are fulfilled. 

The space /* is defined to consist of the bounded sequences x = t£ 
with the norm 


lxi = sup lé}. 
For any. x € /? we have 


(3.11-4) sup |&,| = lim FAGY E wid les. 


Some interest attaches to various subspaces of /^. We mention in 
particular the space of all convergent sequences x — {é,}. We denote this 
space by (c). 

^ Sometimes it is convenient to denote the norm in /? by ||x]|,, and that in /v 
by lixlko It is worth noticing that the elements of /? form a subclass of 
the elements of l if 1 < p < q < œ, and that then xi, < ||x||, if x e /» 
(see Jensen's inequality in the Introduction). 

The space lr is separable if 1 < p < oo. To see that this is so let us 
first introduce some terminology. A point x € /? will be called rational 
if x = {é,} and each é, is rational. In the case of the complex field a 


$3.11] TOPOLOGICAL LINEAR SPACES 89 


number &, is called rational if its real and imaginary parts are rational. 
A point x = (£,) will be called of finite type if the set of n for which 
é, # 0 is finite. The set of all rational points of finite type is readily 


seen to be countable. It is also everywhere dense in /». For, suppose 
o 


e > 0 and x eíl». We choose N so that > é|? < €P/2, and then we 
n=N+1 
choose a rational point of finite type, say y = {n,}, such that s, = 0 if 
n> N, and |£, — «| < (2N)-Vre if k = 1, ++», N. Then 
oo 
eP 


N 
Ix — yie = D lé — ml? + m. lel? < Ny e 5 =e, 
n=1 


n=N+ 


so that |x — yl < e. Thus X is e 

The space I© is not separable, however. For, if (x,) is any countable 
set in /?, with x, = (£9, £9, .. +), let x = (£,) be the element of / defined 
by é =f +1 if |£?| « 1 and £, =0 if || > 1. Then the kth 
component of x — x, is é, — &, and |£y — &?| > l,sothat|x — x, > 1 
Thus the set (x,) cannot be dense in /^, and /? is not separable. 


Example 3. Let T be any nonempty set, and let B(T) be the class of 
al! bounded functions x defined on T, with either real or complex values. 
Then B(T) becomes a normed linear space if we define 


ixil = sup |x(Df. 
eT 


The scalar field for B(T) will be the same as the field in which the function 
values are required to lie. 

Observe that /* is the special case of B(T) in which T is the set of 
positive integers. In the special case where T is an interval [a, 5] of the 
real axis, we shall denote B(T) by B[a, 5]. 

If T is an infinite set, B(T) is not separable. This is shown by the same 
kind of argument that was used in showing the nonseparability of /«. 


Example 4. Suppose T is a topological space. Let C(T) denote the 
class of bounded and continuous functions x defined on T. Then C(T) 
is a linear manifold in B(T), and we consider C(T) as a normed linear 
space on its own account, with the norm as defined in B(T). If T is 

compact, the requirement that the values x(t) be bounded is fulfilled 
automatically as a consequence of the assumption that x is continuous on 
T. This is because of Theorem 2.2-C and the fact that a compact set of 
real or complex numbers is bounded.. It is moreover true that, if 
x € C(T), there is some point f,, € T such that 


|x(t,)| = max |x(t)| = lixll. 
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This is because |x(r)| is continuous on T and a compact set of real numbers 
is closed as well as bounded. 

If T is a finite closed interval on the real axis, we shall usually denote 
C(T) by Cla, b] (see Example 3, § 1.2). 


Example 5. The class .Z» = £?(— oo, œ) and the corresponding 
linear space L? were defined in Example 7, 81.2. Here we assume 
lsp<o. Ifxe Yr we write 


Q3.11-5) lixil, = es |xole at)” 


Evidently |x|, = 0 is equivalent to x(t) = 0 ae. and ||x\|, = |lyll, if 
x =9y, Minkowski’s inequality for integrals (see the Introduction) states 
that 


Ix + yl < lixlp + Iyl 


if x, ye He, Hence, if [x] € L? and we define ||[x]]| = ||xi|,, L? becomes 
a normed linear space. As stated in § 1.2, we shall usually write x in 
place of [x]. Also, we shall write |[x| instead of ||x||, if the situation is 
such that the use of the index is not essential. 

Instead of functions defined on (— œ, œ), we can consider any 
measurable set E in n-dimensional Euclidean space. The classes Z7 and 
Le are then defined with reference to Lebesgue integrals over E, and we 
indicate the dependence on E, if necessary, by writing #(E) and L?(£). 
Still more generally, as we shall see later, it is possible and desirable to 
consider the case in which E is replaced by a more general measure space 
and the integrals are defined in terms of a more general measure. 

The space L'(E) is separable. See problem 5, § 7.3. 


Example 6. Let (a, b) be an interval, finite or infinite of the real axis. 
A measurable function x defined on (a, b), with real or complex values, 
is called essentially bounded if there is some A 2 0 such that the set 
{t:|x(t)| > A} has measure 0 [i.e., such that |x(t)| < A almost everywhere 
on (a, b)]. If such a constant exists, there is a least one; we call this 
smallest possible A the essential least upper bound of x, and denote it by 
sup? [x(?). The notation sup? distinguishes sup? |x(t)| from the ordinary 
least upper bound sup |x(r)|. It can of course happen that sup? |x(r)| < 
sup |x(1)|, and it can even happen that sup? |x(t)| < oo butsup [x(t)| = oo. 
Another characterization of sup? |x(t)| is the following: It is the largest 
number B such that if e > O the set (r:|x(r)| > B — e) has positive 
measure. 

Let $^ denote the class of all measurable and essentially bounded 
functions x defined on (a, b). If x, y #°, we write x =° y if x(t) = y(t) 
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a.e. We then define the linear space L^ in relation to #© just as we 
defined L” in relation to .Z» (see Example 7, § 1.2). If x =° y, it is clear 
that sup? |x(r)) = sup? |y(z)]. Hence, if we define 


IIx] = sup? |x(I, 


L^ becomes a normed linear space. 

The space L® is not separable. For, ifa < s < b, let x, be the character- 
istic function of the interval (a, s) as a subset of (a, b). Then it is clear 
that |i[x,] — [x] = 1 if a « s « t « b. Now consider the family of 
spheres ||[x] — [x,]| < 4 with centers at [x,] in L®, for various values of 
s. No two of these spheres have points in common, and there are 
uncountably many of them. It is therefore clear that any set which is 
everywhere dense in L^? cannot be countable, so that L® cannot be 
separable. 

If (a, b) is a finite interval and x € Z”, then x € Xr for every p > 0, 
and it can be proved that 


(3.11-6) lim ( i ' xo a)" = sup? [x(?)]. 


In fact, if A < sup? |x(r)| and E is the set where |x(t)| > A, we have 
m(E) > 0 and 


Alm vr < ( Í f oleae)” 2b = awe Du: 


Letting p — oo, we see that 
l/p 


b l/p = b 
A < lim (] Ix(o d < fim (f xol» at) < sup? |x(0)]. 


Since A can be as near sup? |x(z)| as we please, this justifies (3.1!-6). If 
- the interval (a, b) is infinite, (3.11-6) is replaced by 


1/, 
(3.11-7) lim lim ( i xl a) ” — sup? [x(0)], 
En 


n> p— oo 
where E, is a sequence of finite intervals such that E; C E2 © ---, each 
E, lies in (a, b), and | E, = (a, b). 


Example 7. The linear space BV[a,b] of functions of bounded 
variation on [a, b] was defined in Example 8, 81.2. If x € BV[a, b] and 
V(x) denotes the total variation of x(t) for a < t < b, we can define a 
norm by 


(3.11-8) lix = [x(a] + VO. 
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The space BV [a, b] is not separable. This may be shown by the same 
kind of argument that was used in showing the nonseparability of Le. 

Many interesting spaces can be formed from classes of analytic functions 
of a complex variable. Let N denote the class of all functions f(z) which 
are defined, single valued, and analytic in the unit circle |z| « 1 of the 
complex plane. This class is a complex linear space. We shall in the 
next two examples describe some subspaces of 9f which become normed 
linear spaces with appropriately defined norms. 


Example 8. Suppose 0 < p < œ. For any f e3L and O <r < 1 let 


G.11-9). min = (a | MEC ao)" 


The class H? is by definition composed of those feE% such that 
sup M,[f;r] < œ. If 1 < pit is clear by Minkowski's inequality that 


O<r<l 

f+gisin HP if f and g arein He. If 0 < p « 1, this same conclusion 
follows from the following inequality [Hardy, Littlewood, and Pólya, 1, 
formula (6.13—6)]: 


2n 2n 2r 
Gio) f7 fret) + gtre'mip ad < [Ureimlo ab + |" gteat. 
0 
It is thus seen that H» is a linear space. If 1 < p we define 
(3.11-11) fll = sup 9X,[f;r]. 
Oszr«l 


This has the properties of a norm; thus H? is a normed linear space if 
lp. If 0 c p <1, (3.11-11) does not define a norm, for the tri- 
angularity condition |f + gll < IfI + ligl| is not always satisfied. 

It is natural to define H* as the class of those f € 9f such that the values 
f(z) are bounded. We define a norm on H* by 


Ifi = sup |f). 
iz «t 
That H^ is a natural notation for this space is seen from the fact that, 
if f e $t and O <r < 1, then 
max | f(z)| = lim Lf; r], 
lz|-r po 
while, if fe H^, then 
= zZ LI 
Ifl = sup. { max [i n 
For complete uniformity of notation we define 
Mol fs r] = max [fo]. 
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Then (3.11-11) is the definition of the norm in H? for 1 < p < oo, and 
HP consists of those fe A such that ||f|| < oo. 

The space He is separable if 1 < p < oo. This may be shown in various 
ways. If one makes use of the fact that L^ is separable, the separability 
of He follows at once from the following facts: If fe Hr, then lim f(rei9) 


exists for almost all values of 0, thus defining a function which we 
denote by f(ei?&) Moreover, the latter function belongs to L^(0, 27), 
and . 


MEL (5 I Irene ar) ^ 


For these facts about Hr», we refer the reader to F. Riesz, 2, and 
A. Zygmund, 1, pages 158-162. Thus H? is in isometric correspondence 
with a subset of L?, Since any subset of a separable metric space is itself 
separable, we see that H? is separable. 

The space H^ is not separable, however. To show this, it suffices to 
show that the set of all f e H™ such that ||f|| = lis not separable. Let 
{f,} be any sequence from this set. Then Mo[f,;7]—>1 as r— 1, for 
each n. Chooser, > 0so that r, < r < 1 implies M[f,; r] 2 1/2. Let 
Pn max — 1/n?}, and choose points «, so that |o,| = p, and 
|SK] = Rolfa; p] Thus 1 — H/m < le] <1 and [flen] > t/a 
Now define D (2) by the Blaschke product 


fle) = IN ls EEL 


1- &z 


Then fe H”, f(«,) = 0, and ||f|| = 1, for it is known that |/(ei)| 21 
for almost all values of 9. (See pages 160-161 and pages 163-164 of 
Zygmund, 1, or F. Riesz, 2) Finally, |f, — fl! 2 |f, (e) — f(e,)| 2 !/;. 
Thus H^ cannot be separable. 


Example 9. Let CA denote the class of functions f which are defined 
(single valued) and continuous when |z| < 1 and analytic when |z| « 1. 
Evidently CA is a linear subclass of H® and is a normed linear space with 
the norm defined as in H^. Because of the maximum modulus theorem 
and the fact that f is continuous, it is clear that for fe CA 


(3.11-12) Ifl = max [f(2)|- 


The space CA is separable. In fact, the linear combinations of the 
functions 1, z, z2, «<+, z^, ---, with complex rational coefficients, form a 
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set everywhere dense in CA. This can be seen, for instance, from Fejér's 
theorem on the (C, 1) summability of Fourier series. If 


fe) = > az" 
0 
is in CA, the Fourier series of f(ei9) is 


2 a,e'"9, 


0 
and this series is uniformly (C, 1) summable to f(e!*) (Zygmund, 1, page 
45). This implies that 

n—1 

> (1 — k/n)a,z* 

k=0 
converges to f(z) uniformly in |z| < 1 as n — oo. 

The spaces H? with 1 < p x coand the space CA have been investigated 

in connection with more general studies of Banach spaces composed of 
functions which are analytic in the unit circle. See Taylor, 4. 


PROBLEMS 


I. The complex space C(T) is separable if and only if the corresponding real 
space is separable. 

2. The real space C[a, b] is separable if [a, b] is a finite closed interval of the 
real axis. One way of seeing this may be outlined as follows: For each positive 


integer n and each set of n + 1 rational numbers ro, rj, * * *, Fa, divide [a, b] into 
2n equal parts by points fo, fi. - : -, f2, (in order from a to b); then define a 
function x by setting x(f) =r, if fj, € t X ty, k 2-0, 1, +--+, n— 1, 


X(f2,) = r,, making x(7) linear in each of the remaining subintervals in such a 
way that it is continuous at all points. The set of such functions is everywhere 
dense in Cla, b]. 

3. The separability of C[a, b] may also be established by relying on the known 
theorem of Weierstrass which states (in effect) that those elements of Cfa, b] 
which are polynomials in ¢ are dense in C[a, b]. One then shows that the 
polynomials with rational coefficients are also dense in C[a, 5]. 


N 


3.1} Finite-Dimensional Normed Linear Spaces 


We saw in Theorem 1.4-A that two linear spaces of the same finite 
dimension 5 over the same scalar field are isomorphic. Now we shall 
see that, if each of the two spaces has a norm, the spaces are topologically 
isomorphic according to the definition of $ 3.1. 
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Theorem 3.12-A. Let X, and X; be two normed linear spaces of the 
same finite dimension n, with the same scalar field. Then X, and X, are 
topologically isomorphic. 


PROOF. The casen = O is trivial, and we assume n > 1. It will suffice 
to prove that, if X is an n-dimensional normed linear space, it is topo- 
logically isomorphic to /!(n), for the relation of topological isomorphism 
is transitive (as well as being reflexive and symmetric). Suppose that 
Xj: X,isa basis for X. If x = £x, +-+- + é,x, is the representation 
of an arbitrary x € X, we know from 81.4 that the correspondence 
x «2 (Ei, +++, &,) defines an isomorphism of X and /!(n) By Theorem 
3.1-C, all we have to prove is that there exists positive constants m and 
M such that 


(3.12-1) léxi tee Ex < MIT o IED 

and 

(3.12-2) m(|é;| Tee + EAD E lléyxi Tes F £ xli 

for all possible sets of values (£i, = £). Now (3.12-1) is evidently 
true if we choose for M the maximum of [xil ---, |lx,j. To prove 
(3.12—2) it suffices to show that m < [£x +--+ + Eo if Jé] +- + 
(£| = 1, for (3.1222) certainly holds if é;=---=& — 0, and, if 


c= [E +--+ + jé] > 0, wecan define y; = cté; whence [yi] +--+ + 
In| = 1, and Imxi +--+ + MXi = cep +--- + Ex], so that 
(3.12-2) holds if m < |mixi + +++ + Meal. 

Now let fés -n &) = léxi + «+: + £x]. The function f is 
continuous on /!(m) as a consequence of (3.12-1). In fact, since 
| xl — lyi | < lix — yil, we see that 


|f. Ata, &) — fim. tt 3)] X (£i = m)»X1 «Tee G a An)Xnll 
«MA — ml e — Ml) 


whence the continuity of fis clear. Now the surface of the unit sphere 
in /!(n) (the set S for which |é] + --- + lén] = 1) is compact, as we see, 
for example, by the use of Theorem 2.4-H and the Bolzano-Weierstrass 
theorem for scalars. Hence f, being continuous on S, attains a minimum 
value m > 0 on S. But m > 0, for m = 0 would imply that xj, ---, x, 
are linearly dependent, contrary to the fact that they form a basis for X. 
The proof of (3.12-2) and of Theorem 3.12-A is now complete. 

It is clear from Theorem 3.1-C that, if X and Y are topologically 
isomorphic normed linear spaces and if one of them is complete (as a 
metric space), the other is also complete. Now /!(n) is evidently complete 
(as a consequence of the completeness of /!(1), the real number field). 
Thus we have: 


96 INTRODUCTION TO FUNCTIONAL ANALYSIS [$3.I2 


Theorem 3.12-B. 4 finite-dimensional normed linear space is complete. 
As a corollary of this we have: 


Theorem 3.12-C. Jf X is a normed linear space, any finite-dimensional 
subspace of X is necessarily closed.. 


Another important result is the following: 


Theorem 3.12-D. Jf X is a finite-dimensional normed linear space, 
each closed and bounded set in X is compact. 


PROOF. This proposition is true (by classical analysis) for the particular 
finite-dimensional space /!(m) It then follows, by virtue of Theorem 
3.12-A, that the theorem is true for any finite-dimensional space X, for 
the properties of being bounded and closed are transferred from a set S 
to its image S, in /1(n) by the topological isomorphism, and the compact- 
ness is then carried back from S, to S. 

The converse of Theorem 3.12-D is also true. Before proving the 
converse, we consider a general theorem due to F. Riesz which is useful 
in many arguments. 


Theorem 3.12-E (Riesz's Lemma). Suppose X is a normed linear 
space. Let X, be a subspace of X such that Xo is closed and a proper 
subset of X. Then for each @ such that O < 8 < 1 there exists a vector 
Xe € X such that ||x,l| = 1 and |x — xj] > 8 if x € Xo. 


PROOF. Select any x, € X — Xo and let 


d = inf |x — xli. 
xeXo 


Since X, is closed, it follows that d > 0. There exists xy € X, such that 
Xo — xıl| € 0-!d (because 0-!d > d) Let xə = h(x; — xg), where 
h = dx, xg|-!. Then |x| = 1. If x € Xo, then Aix + xo € Xp also, 
and so 


lx — xoll = |x — Ax, + Axol| = Rl tx + xo) — xil > hd. 


But hd = ||x, — xgl|-1d > 0, by the way in which x9 was chosen. Thus 
lx — x,|| 2 8 if x € Xo, and the proof is complete. 

We can restate Riesz's lemma as follows: Jf X is a closed and proper 
subspace of X, there exist on the surface of the unit sphere in X points whose 
distance from Xy is as near 1 as we please. This is the most that can be 
said in general however. It need not be true that there are points on 
the unit sphere whose distance from X, is equal to 1. 


Example. Let X be that subspace of the real space C[0, 1] (see 
83.11, Example 4) consisting of all continuous functions x on [0, 1] such 
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that x(0)= 0. For X, we take the subspace of all x & X such that 


1 
f x(t) dt = 0. Now suppose that x, € X, ||x,|| = 1, and |xy — x| > 1 
if x€ Xs. Corresponding to each y € X — Xp let 


Í j x(t) dt 
0 


c = Z 
i y(t) dt 
0 


Then x, — cy € Xp, and so 1 < lxi — (xi — cyl] = lel Ilyli, or 


ip xÀ 4| < | ih l x,(4) «| Ili 


1 
for each y € XY. Now, we can make i y(t) dt| as close to 1 as we please 
0 


while maintaining |y|| = 1 (e.g., let y,(f) = t! and let n — oo). Thus 
we see that 


LT 
I< uu x (ð | 
0 
But, since |lxil| = max |x,()| = 1 and x,(0) = 0, the continuity of x, 
O<t<1 
shows that we must have 


<l, 


| f x,(t) dt 


and thus we have a contradiction. Therefore, with Xo and X as here given, 
there is no point on the surface of the unit sphere in X at unit distance 
from Xo. 

We come now to the converse of Theorem 3.12-D. 


Theorem 3.I2-F. Let X be a normed linear space, and suppose the 
surface S of the unit sphere in X is compact. Then X is finite dimensional. 

Suppose that X is not finite dimensional. Choose x, € S, and let X; 
be the subspace generated by xj. Then X; is a proper subspace of X, and 
it is closed (by Theorem 3.12-C). Hence, by Riesz's lemma, there exists 
x,€ S such that |xo — x,l| > !/j. Let X; be the (closed and proper) 
subspace of X generated by x,, x2; then, there must exist x; € S such that 
[x4 — x|| > !/;if x€ X;. Proceeding by induction, we obtain an infinite 
sequence {x,} of elements of S such that ||x, — X,_|| 2 !/; ifm # n. This 
sequence can have no convergent subsequence. This contradicts Theorem 
2.4-H, since S is compact. Thus X must be finite dimensional. 

Another proof, using the definition of compactness directly, may be 
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given as follows: The family of all open spheres of radius !/; with centers 
on S is an open covering of S. Since S is compact, there must exist a 
finite number of points x,, ---, x, on S such that S is covered by the set 
of open spheres of radius 1/, with centers at x, +++, x,. Let M be the 
finite dimensional, and therefore closed, subspace of X generated by 
X tte, X, Then. M must be all of X. For, if not, by Riesz's lemma 
there exists a point xg € S whose distance from M is greater than !/;, and 
this point x9 cannot be in any of the spheres which cover S. Since 
M — X, X is finite dimensional. 


PROBLEM 


If X and Y are normed linear spaces, if X is finite dimensional, and if T is a 
linear operator on X into Y, T is necessarily continuous. 


3.13 Banach Spaces 


If a normed linear space is complete, it is called a Banach space. While 
many propositions about normed linear spaces do not require the hypo- 
thesis of completeness, a number of theorems of critical importance do 
depend upon completeness. In particular, there are some important 
theorems in the theory of linear operators which make use of the theorem 
of Baire (Theorem 2.41—-C), and this is made possible by the assumption 
of completeness for the normed linear spaces under consideration. In 
some work it is necessary to construct elements of a normed linear space 
by means of infinite series or integrals, and completeness is then needed 
to insure the existence of limits. 

If a normed linear space is not complete, we may complete it as a 
metric space by the process described in the proof of Theorem 2.41-A. 
It is important to know that we can complete X, not merely as a metric 
space, but also as a normed linear space, That is, using the notation of 
Theorem 2.41-A, where X is the normed linear space and Y is its completion 
as a metric space, the space Y can be made into a linear space in such a 
way that the subset Yọ (which is isometric with X and dense in Y) is 
congruent to X as a normed linear space. 

Suppose y, v € Y, and let {x,}, (u,) be Cauchy sequences from X which 
are in the equivalence classes y, v respectively. Then (x, + u,} is a 
Cauchy sequence, since 


[Ix * us) > (Xm F Um)|| < Xn nd Xml! + l|, 2 Um|l- 
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Moreover, if {a,} and {5,} are Cauchy sequences equivalent to {x,} and 
{u,} respectively, then (a, + b,) is equivalent to (x, + u,}, because 


lx, + Un) FX (a, + by) < Xn = A + ILA E byl. 


Thus we can define y + v as that equivalence class which contains 
(x, + u,}, and the definition depends only on y, v, not on the particular 
choice of {x,}, {u,}. Likewise we define «y as the equivalence class 
which contains {«x,}, and we define ||y|| = lim |x,|. The zero element 


of Y is the unique equivalence class all of whose members (x,) are such 
that x, — 0. It is a routine matter to verify that Y is a normed linear 
space and that Y, (defined in the proof of Theorem 2.41-A) is a linear 
manifold in Y congruent to X. Finally, the metric defined in Y by the 
norm is the same as the metric defined in Y by the completion process of 
Theorem 2.41-A when the metric of X is defined by the norm in X. 

It is convenient to adopt a standard notation and terminology regarding 
the completion of a space X. It is evident that we can adjoin certain 
“ideal” elements to X so as to obtain a complete space in which X is 
everywhere dense. This complete space will be called the completion of 
X, and denoted by ¥. The important feature of this arrangement is that 
X is actually a subspace of €, whereas in the original process of completing 
a metric space, we obtain a complete space Y whose elements are equiva- 
lence classes of Cauchy sequences from X, so that X is not actually a 
subset of Y. A space X is complete if and only if X — X. 

There is a particular kind of extension theorem for linear operators 
which we shall need later and which is convenient to discuss here. 


Theorem 3.13-A. Let X and Y be normed linear spaces, and let T be 
a continuous linear operator on X into Y. Then there is a uniquely deter- 
mined continuous linear operator T on X into Y such that Tx = Tx if 
x€X. Therelation |f|| = |T|| is valid. 


PROOF. To define 7 we suppose € € X, and select a sequence (x,) from 
X such that x, — £. Then (x,) is a Cauchy sequence, and 


i Tx, B Tx, = IIT Gc, m Xml < IT Xn T Xmll, 


so that (7x,) is a Cauchy sequence in Y. Consequently 7x, — f, where 
fis some element of f. It is readily proved that f depends only on £ and 
T, not on the particular sequence {x,}. We define 7€ = f. It is a simple 
matter to verify that Tx = Tx if x e X and that Î is linear. We see that 
lx, — Il, Tx, < ITI lal, and hence |T*j < ITHIK. Thus 7 is 
continuous and ||| < ||T|| (see § 3.1). On the other hand, if x € X, we 
have (Tx|| = ||7x\| < ifi ixi, so that Ti] < IfI. Hence Z| = ITI. The 
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uniqueness assertion about 7 is easily justified by using the fact that X 
is dense in X. 


Theorem 3.13-B. Jf X is a Banach space and Xy is a closed linear 
manifold in X, then Xo, considered as a normed linear space by itself, is a 
Banach space. 


PROOF. This is a special case of Theorem 2.41-E. 

It is useful to note that a Cauchy sequence {x,} in a metric space is 
bounded, irrespective of whether or not the space is complete. Hence, 
if {x,} is a Cauchy sequence in a normed linear space, the sequence of 
norms ||x,|| is bounded. 

One simple but important property of Banach spaces is shown in the 
following theorem: 

Theorem 3.13-C. Let X be a Banach space, and let {x,} be a sequence 


o e 
of elements of X such that >, |x,|| < oo. Then, the infinite series 2. X, 

1 1 
is convergent and defines an element of X. 


PROOF. Lety, = x, +--+: +x, Then {y,} is a Cauchy sequence, for, 
if m <n, |y, — Yml) € Xml +--+ lix, and we can employ the 
Cauchy criterion on the series >\|x,||. Since X is complete, it follows 
that lim y, exists. f 


We turn to a discussion of completeness for the examples of normed 
linear spaces given in §3.11. We already know (Theorem 3.12-B) that 
every finite-dimensional normed linear space is complete. 

The space lr, where p = 1, is complete. Let (x,) be a Cauchy sequence 
in fp, with x, = (€?, &, ...). For each fixed k, (£(?) is a Cauchy 
sequence, because 


oo 1/p 
|f? — &| < » pe ir) = lix, — Xml 
i=l 


Let £, = lim £?. We shall first prove that the sequence (£,) is an 


noo 


element of r. We know that ||x,|| is bounded, say ||x,|| < M. Now, for 


any k, 
k 1/p 
(È er) < Ix] « M 
i-i 


Letting n — oo, we obtain 


> DN <M. 
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Since k is arbitrary, this shows that (£,) € /? and that its norm does not 
exceed M. Let x = {é,}. It remains to prove that |x, — x||>0. 
Suppose e > 0. Then there exists an integer N such that ||x, — x,|| < € 
if N « mand N <n. Therefore, for any k, 


I 


k l/p 

£o — in) €lx,—-x4l«e 
i=1 

< 


if N «mand N <n. Keeping k and n fixed, let m — œ. This gives 


k 1/p 
(un - air) < 
i=l 


if N< n. Since this is true for all k, we can let k — œ, and we obtain 
the result that ||x, — x|| < e if N < n. This finishes the proof that /» 
is complete. 

The form of the foregoing argument is such that it can be adapted to 
proving the completeness of a number of spaces. To avoid much repe- 
tition of essentially the same argument we shall formulate a general 
theorem which embodies the principle of the argument. 


Theorem 3.13-D. Let Y be a linear space. Let S be a certain class 
of sequences (y,) of elements of Y, and let F be a certain family of real- 
valued functions defined on Y. We assume that S and F satisfy the following 
conditions: 


1. With each (y,) € S is associated a certain element y € Y. This 
association is indicated by writing y, — y. 

2. If (y, € S, with y, — y, then for each fixed k the sequence {z,} with 
Zn = yy — Yn is in S, and Z, — y, — y. 

3. If {y,} € S, with y, > y, then f(y,) > F(X) for each f e F. 

4. The class X of x € Y such that Sup f(x) « +œ is a linear manifold 


in Y and the function ||x|| on X defined by 
ixl = sup f(x) 
fes 


is a norm on X. 

5. If (x,) is a Cauchy sequence in X (relative to the metric topology 
defined by the norm of (4)], then (x,) € S. 
With these assumptions, X is a Banach space (i.e., it is complete). 


PROOF. Suppose that (x,) is a Cauchy sequence in X. Then there is 
some M such that |x,|| < M for all values of n. By (1) and (5) there is 
some x € Y such that x, — x, and by (3) it follows that /(x,) — f(x) for 
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each fe F. Now f(x,) < ||x,|| < M for each fe F, by the definition of 
the norm. Letting n — oo, we see that f(x) < M. Since this is true for 
every f € F, we see by (4) that x e X and [ix| « M. Now, if e > 0, there 
exists an integer N such that x, — x,,|| < eif N < nand N < m. There- 
fore, for each fe F, f(x, — Xm) < € under the same conditions on m and 
n. Letting m — oo, we see by (2) and (3) that f(x, — Xm) — f(x, — x), 
and so f(x, — x) € e. This is true for each fe F and each n > N. 
Therefore |x, — xl < e if N € n. This finishes the proof that X is 
complete. 

To see the application of this theorem to /? let Y be the linear space of 
all sequences y = {n;}, where 71, n>, --- are scalars. Let S be the class 
of all sequences {y,} in Y (where y, = (7/?)) such that lim z(? = 7, exists 


Li 


for i= 1, 2, ---, and let the associated ye Y be (y). Let F be the 
countable family of functions f4, f2, ---, with f, defined by 


k l/p 
jn = (X me)" yey. 
i=1 


Then Theorem 3.13-D can be applied with X = P. Our proof that /» 
is complete follows exactly the same lines as the proof of Theorem 3.13-D. 

It is easy to give examples of incomplete normed linear spaces. Con- 
sider, for example, the subset X of łe (1 € p « oo) consisting of 
sequences x = (£,) such that the set of n for which é, # 0 is finite. This 
subset of /? is a linear manifold and can be regarded as a space by itself. 
It is not complete. For, let x be an element of /? that is not in X. If 
x = {é}, let x, = (Éi, £5, £,0,0,---). Then x, e X, and {x,} isa 
Cauchy sequence in X. But the sequence has no limit in X, for, if it 
did, say x, — y, we should have y — x, since it is readily seen that x, — x, 
and the limit of a convergent sequence is unique. But ye X and x ¢ X. 
Thus we have a contradiction, and we have proved that X is not complete. 

The essential principle in the foregoing argument shows us the truth 
of the following statement: If X is a linear manifold in a normed linear 
space Y such that X is dense in Y but a proper subset of Y, then X, 
considered as a normed linear space by itself, is not complete. 


PROBLEMS 


l. Theorem 3.13-D may be used to prove that a number of spaces are com- 
plete. Indications of procedure are given below. Details are left to the reader. 


a. B(T) is complete (see Example 3, § 3.11). Let Y be the linear space of all 
scalar-valued functions y defined on T. Let S be the class of sequences {y,} 
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from Y such that dim. y,(t) = y(t) exists for each t € T; then write y, > y. Let 


F be the family of | fonctions fa t€ T, defined by f(y) = »(0. 


b. BV [a, b] is complete (see Example 7, 83.11). Choose Y and S as in (a), 
with T = [a,b]. For F take the class of all function f4, defined by 


fa) = Ix) + > ba) — G1. 
i-i 


where 4 is the partition of [a, b] by the points fo, 4, - - , f, (a = to < fi < 
< 1, = b); F is generated by taking all possible A's. 

c. HP? is complete, | < p < œ (see Example 8, 83.11). Let Y be the class 
Q (defined previously) of all functions y of the complex variable r, defined and 
analytic when |r| < 1. Let S be the class of sequences {y,} from Y such that 
y,(t) is convergent to a limit y(t) as n — oo, uniformly with respect to f in every 
compact set lying in the open unit circle |z| < 1. For F we take the family 
of functions f, defined by 


RO) = M iy; r, Oxrc«l. 


The meaning of W, is explained in 83.11; we are now using y where f was 
used in $3.11. The X of Theorem 3.13-D is H? in this case. For x eX it 
may be proved that 

lix! 


[x9] < 1-1 


if |r| < 1, and from this it follows that condition 5 in Theorem 3.13-D is 
satisfied. The proof of the inequality runs as follows: Let 


x(t) = S Ent” 
n=0 


ELE 
Rrr” 


27 
&- Í x(rei)e-int d9, O<r <i. 
0 


Then 
r|£| « Myl; rl < lixll 
whence [£,| < Ixl] and 


dixe 


= l 


[x(| < P It" = 1 


Ifp = œ we have the stronger inequality 
[x] < Ilxll. 


d. The space C(T) is complete (Example 4, § 3.11). It suffices to show that 
C(T) is closed in B(T). This follows from the fact that in B(T) lx, — x|| — 0 
signifies uniform convergence of x,(t) to x(/). 

e. The space CA is complete (Example 9, 83.11). Argument as in (d), with 
H® in place of B(T). 

2. The space L'(E) is complete (Example 5, $3.11). Herel < p < œ and E 
is a measurable set in Euclidean space of n-dimensions. This fundamental 
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theorem in the theory of Lebesgue integration goes back to work of Fischer and 
F. Riesz; see, e.g., Titchmarsh, 1, 812.5. For the result in a more abstract 
setting see § 7.1. 


3. The space L9 is complete (Example 6, § 3.11). The argument is left to the 
reader. 


3.14 Quotient Spaces 


Let X be a linear space, and M a linear manifold in X. Two elements 
X1, X2 € X are said to be equivalent modulo M if x, — x € M. We write 
x, = x, (mod M). It is clear that this kind of equivalence has the usual 
properties of an equivalence relation, namely reflexivity, symmetry, and 
transitivity. Hence X is divided into mutually disjoint equivalence 
classes, two elements being in the same equivalence class if and only if 
they are equivalent modulo M. The set of all these equivalence classes 
is denoted by Y/M. We shall explain how to define addition and multi- 
plication by scalars in X/M so that it becomes a linear space. Let [x] 
denote the equivalence class which contains the element x; thus 
[xi] = [x;] if and only if x, = x; (mod M). We make the definition 
[x] + [y] = [x + y]. To show that [x] + [y] is unambiguously defined 
we have to show that [u + v] = [x + y] if [x] = [x] and [e] = [p]. This 
is at once evident, however, because (x + y) - (u + v) = (x — u) + 
(y — v) and M is a linear manifold. We also define o[x] = [ax], 
observing that [ox] = [ay] if [x] = [y]. It is a routine matter to verify 
that Y/M becomes a linear space as a result of these definitions. The 
zero element of X/M is [0], which is the same as M. 


Definition. The linear space X/M, as described in the foregoing 
paragraph, is called the quotient space of X modulo M. The mapping ¢ 
of Y onto Y/M defined by ¢(x) = [x] is called the canonical mapping of 
X onto X/M. 


To get an intuitive geometric appreciation of the definition of X/M, 
consider the case in which X is three dimensional and the points of X are 
represented in a three-dimensional rectangular-coordinate system, the 
point x = (é,, é, £) having £, én, £ as its coordinates. If M is the 
linear manifold of points (€,, 0, 0) (i.e., the £,-axis), the elements of X/M 
' are the straight lines parallel to the £;-axis. Each such line is uniquely 
determined by the point (0, £, £j) in which it intersects the plane é = 0, 
and it is readily seen that X/M is isomorphic to the linear manifold of 
points (0, é, £4). Again, if M is the linear manifold of points (é, éz, 0), 
the elements of X/M are the planes parallel to the plane £j = 0. Each 
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such plane is uniquely determined by the point (0, 0, £) in which it is 
pierced by the £,-axis, and X/M is isomorphic to the one-dimensional 
linear manifold of points (0, 0, é). The isomorphism between X/M and 
a certain subspace of X, which is apparent in these particular cases, 
persists in general, but we shall not pursue this aspect of the situation 
further. 

If X is a normed linear space and the linear manifold M is closed, it 
is possible to define a norm on X/M. 


Theorem 3.14-A. Let M be a closed linear manifold in the normed 
linear space X. For each element [x] € X/M we define 


(3.14-1) be = inf ppl. 
»ebxl 


Then ||[x]|| is a norm on X/M. If X is a Banach space, so is X/M. 


PROOF. We have 


lxi] + [xl = pes + x2] = inf yl — inf lu vll 
yeDui +x] ue[xi], ve[x2] 
< inf llull + inf loll = lle] + ‘bell. 
P d ue[xi] ve[x2] 
Also i 
le[xTI = |[ox]|| = inf [yl = inf eull = [e| inf liu = le] IEJ. 
yelax] ue[x] ue[x] 


To show that |i[x]|| is a norm it remains only to show that [x] is the zero 
element of Y/M (i.e., that x e M) if [[x]| = 0. Now M is a closed set, 
and from this it follows that each of the equivalence classes [x] is closed. 
In fact, [x] is homeomorphic to M by the mapping y = x + m (x fixed, 
meM,ye[x]. If j[x]| = 0 there is a sequence {y,} such that y, € [x] 
and j|y,|— 0. But then y,— 0, and so Oe[x], which means that 
xe€M. Thus|[x]| isa norm on Y/M. ~ 

Now suppose that X is a Banach space, that is, that X is complete as 
a metric space. To show that X/M is complete it suffices to show that 
every Cauchy sequence in X/M contains a convergent subsequence. For, 
if a subsequence of a Cauchy sequence has a limit, it is an easy matter 
to verify that the sequence itself has this limit. Let (U,) denote a Cauchy. 
sequence in X/M. By induction it is possible to select a subsequence 
{Ui} such that |U,í;,,; — Unel! < 1/24, i = 1,2,--+. For convenience 
we write V; = Unay Now select w; € Vi, — V; (this is a vector differ- 
ence, not a set-theoretic difference) so that ||w;| < 1/2771, i = 1, 2, ---. 
This is possible by the way in which the norm is defined in X/M. Select 
vı € V4, and, if v,, ---, v; have been chosen, choose v;,, € Vi,, so that 
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Wi = Viy — 0; Then, if m < n, c, — Um = (Un — 0,4) + (0a — 0,3) 


1 
Heee + Omar — Em) Wa — Pall S Waal + [Wall bo H Wall < 5:4 
Toe 2 « XY Therefore {v,} is a Cauchy sequence in X, 


and v = lim v, exists. Let V = [v]. /Then 


no 


IV, — Vil = ile, — eJ < llo, — vll. 


so that V, — V. This finishes the proof that X/M is complete. 
For instances of the use of the quotient-space concept, see Theorem 
4.3-F and problems 5, 6 in $ 4.6. 


3.2 Inner-Product Spaces 


Definition. A complex linear space X is called an inner-product 
space if there is defined on X x X a complex-valued function (xi, x2) 
(called the inner product of x, and x2) with the following properties: 


L. (xy + Xp, x3) = (X1, x3) + (2, x3). 

2. (x1, X2) = (x5; X1) (the bar denoting complex conjugate). 

3. (axi, x2) = e(x1, x3). 

4. (x, x) is > O [it must be real by (2)], and (x, x) # 0 if x z 0. 


A real linear space X is called an inner-product space if there is defined 
on X x X a real-valued function (x;, x;) with the properties 1—4, except 
that (2) is to be written without the bar over (x2, xj). 


Observe that, as a consequence of the properties listed, (x,, x2) has 
the further properties: 


(X1, X2 + x3) = (x1, x2) + (x1, x3), 
(x1, «x5) = &(x1, X2) 


where the bar over « is to be omitted in the case of a real space. 

There are fifteen theorems in this section; the last twelve of them refer 
to orthonormal systems. Of these latter theorems, the principal ones are 
3.2-D (the generalized Bessel inequality), 3.2-G (the abstract counterpart 
of the classical Riesz-Fischer theorem), 3.2-H [one form of the projection 
theorem; see also problem 4, $4.81, and $4.82], 3.2-K (the Parseval 
identity), and 3.2-L (the Gram-Schmidt orthogonalization process). 

The first important fact to be noted about inner-product spaces is that 
we can use the inner product to define a norm. We must first prove the 
following theorem. 
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Theorem 3.2-A. Jf X is an inner-product space, then 

(3.2-1) (x1, X2)| < VG, xi) V G6, x2). 

The equality holds in (3.2-1) if and only if x, and x; are linearly dependent. 


PROOF. For any « and f we have («x + By, ax + By) = «a(x, x) + 
eB(x, y) + aB(y, x) + BB(y, y) 2 0. The idea of the proof is to reduce 
this to an inequality of the form Ar? + 2Bt + C > 0, with A, B, C real 
constants and ¢ a real variable. We choose « = t (real) and define 


053) | 
Poe: ERA 


B = 1, otherwise. 
Thus A(x, y) = |(x, y)| and 88 = 1. Therefore 
(3.2-2) (x, x) + 2005 y)| + (y) 20 
for all real t. We conclude that 
(x, np? Tus (x, x). y) < 0, 
which is equivalent to (3.2-1). The equality |(x, y)|? = (x, x)(y, y) can 
hold when x # 0 if and only if there is a real value of t for which the 
quadratic form in (3.2-2) takes on the value 0. But, because of the origin 
of the quadratic form, we see that this occurs if and only if tx + By = 0 
for some real t and some £ such that |B| = 1. This relation implies and 
is implied by the statement that x and y are linearly dependent, provided 
that x #0. When x = 0 the equality holds in (3.2-1), of course, and 
also x and y are linearly dependent. Thus the proof is complete. 
The inequality (3.2-1) is known as Schwarz's inequality. 


Theorem 3.2-B. If X is an inner-product space, V(x, x) has the 
properties of a norm. 


PROOF. We write |x| = v(x, x). The only requisite property of ||x|] 
that is not immediately apparent is the triangular inequality property. 
Now 


lx + yl = (x, x) + (x, y) + (y, x) + (y, y). 


For complex A we write Re A = 1/,(A + A) = real part of A. Since 
[Re A| < |A|, we see that 


lx + yi < |lxl? + 2/6 »)] + 11912. 
With (3.2-1) this gives 
lix + yl? < x2 + 2i Lvl + yl? = (lxi + ily)? 
Consequently ||x + yii < ||xi] + ill, and the proof is complete. 
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While the norm is expressible in terms of the inner product, it is also 
true that the inner product is expressible in terms of the norm. If X isa 
real inner-product space, we have 


(3.2-3) (x, y) = alix + yl? — lx — yl?]. 


If X is.a complex inner-product space, the real and imaginary parts of 
(x, y) are expressible in the forms 


(3.2-4) Re (x, y) = 4lllx + yl? — lx — yll?], 
(3.2-5) Im (x, y) = — dfllix + y|? — lix — y). 
The validity of these formulas is readily verified by direct simplification 
of the expressions on the right, using the properties of the inner product. 
Throughout the rest of this section the discussion and theorems are 
concerned with inner-product spaces, and we shall not repeat this fact 
every time in stating theorems. It is furthermore assumed that an inner- 
product space is given the topology of a normed linear space, using the 


norm |x| = V(x, x). 


Theorem 3.2-C. The inner product (xi, X2) is a continuous function on 
X x X. 


PROOF. Let x,— u = t, Xj — U = v}, Where x1, X3, uj, uz are 
arbitrary. Then 


(Xi, X2) — (Uy, u5) = (Uy + v1, U2 + v2) — (Uy, u2) 
= (uy, 02) + (vı, u2) + (01, v2). 


Therefore, using (3.2-1) and the definitions of vı, v2, we have 


\(%1, x2) — Q5, u3) < luli x2 — uall 
+ dx, — uli lusti + xs — uli lx — ull. 


The asserted continuity is now evident. 


..4 Examples of inner-product spaces. The space /? is an inner-product 


space, with inner product 


(x, ») - S Els 


n-l 


where x — Enh, y= {nn}- 
The space L?(a, b) is an inner-product space, with inner product 


b eine 
6.» = [xO at. 


The two spaces just mentioned are complete. We can get many examples 
of incomplete inner-product spaces by selecting nonclosed linear manifolds 


§ 3.2] TOPOLOGICAL LINEAR SPACES 109 


in the aforementioned spaces. For instance, the subspace of L%(a, b) 
which is composed of elements corresponding to functions continuous on 
(a, bl is an incomplete inner-product space. 

The n-dimensional space /?(n) is an inner-product space, with 


(9) = >. rie 
k=1 


One of the most important notions in an inner-product space is that 
of orthogonality. 


Definition. We say that x and y are orthogonal if (x, y) = 0. The 
statement “x and y are orthogonal” is often expressed symbolically in 
the form x | y. 


Observe that x | y is equivalent to y | x; also, x | O for every x. 


Definition. A set S of vectors is called an orthogonal set if x | y 
for every pair x, y for which xe S, ye S, and x # y. If in addition 
|xl| = 1 for every x € S, the set is called an orthonormal set. 


The remainder of this section is devoted to a discussion of orthonormal 
sets. One of the main goals of the discussion is the determination of 
the nature of the closed linear manifold generated by a given orthonormal 
set: How is it related to the whole space? How may an element of the 
manifold be expressed in terms of the elements of the orthonormal set? 
We find here the inequality of Bessel and the Parseval identity. These 
are the general forms of the relations bearing these names which occur in 
the theory of Fourier series. 


Theorem 3.2-D. Let S be an orthonormal set. If uj, +--+, u, is any 
finite collection of distinct elements of S, and x € X, then 


8.2-6) > le wl? < I. 
i-l 


The set of those u e S such that (x, u) # O (x any fixed element of X) is 
either finite or countably infinite. If x, y € X, 


(3.2-7) > I(x, u) FW] < Ixl Lll 
ueS 
it being understood that the sum on the left includes all u € S for which 
Go uy, u) x 0, and is, therefore, either a finite series or an absolutely 
convergent series with a countable infinity of terms. 
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PROOF. To prove (3.2-6) we write £; = (x, uj). Then 


0< ( — y ins — > én) 
= (x, x) — S £(x, uj) — 5 £(uj, x) + > > E,E(u;, uj). 
1 i i i 


But (u;, uj) = 3;, since S is orthonormal. If we take into account the 
definition of £;, we see that 


0 < lxi? — p: és 2 IE] + 2 lė:|2 = xp — > £2, 


and this is equivalent to (3.2-6). 

It follows from (3.2-6) that, if x € X and n is a positive integer, the 
number of elements u of S such that |(x, u)| > 1/n cannot exceed 7?|ixlj?. 
Since |(x, u)| > l/n for some n if (x, u) # 0, the set of those u € S such 
that (x, u) # 0 is a countable union of finite sets and is, therefore, either 
finite or countably infinite. The inequality (3.2-7) now follows from 
(3.2-6), for, if u, +-+, u, is a finite collection of distinct elements of S, 
we have 


n n s/n + 
> los wow! < (> Ice or) (> lo. s) < ixl ipi 
i-i i-i i-l 


by (3.2-6) and Cauchy's inequality. 

Examples of orthonormal sets. Yn the space /? let e,(k = 1, 2, - - -) be 
that element x = {€,} for which é, = 0 if n # k, and £, = 1. The set 
of all the e,’s, or any nonempty subset of this set, is an orthonormal set. 

In the complex space L7(0, 27) let u, be the element corresponding to 
the function (1/V/2z)ei"t(n = 0, + 1, + 2,---) Since 

1 (f? ifm =n 
ifm #n 
we see that the various elements u, form an orthonormal set. 

If we deal with the real space L2(0, 27), the elements determined by the 

functions 


TER E 
Imh e di - lo 


1 1 1 
—— — COS f, — cos 21, 
V 20 T T 
1 1. 
— sint, —- sin 2t, 
Va Va 


form an orthonormal set. 
Other examples of orthonormal sets are mentioned in § 3.22. 
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Theorem 32-E. Suppose X is separable and that S is an orthonormal 
set in X. Then S is either a finite or a countably infinite set. 
PROOF. If x | yand |[x|] = iyl = 1, we have 


(x — y,x — y) = (x, x) — x, y) — Q, x) + (y, y) = 2, 


or |x — y|| = V2. Thus, in an orthonormal set, each pair of distinct 
elements are a distance V2 apart. Now let {y,} be a denumerable set 
everywhere dense in X. Then to each x € S corresponds some n, depend- 
ing on x, such that ||x — y,|| < v/2/3. If x and u are distinct members 
of Sand if lu — y,J| < V2/3, then 


VIZ = [x — ull < lix — yall + UPa — Yall + lys — ul 


< an + NYa — Jal 


or 


v2 
ES < Yn T Ymllə 


so that n # m. There is thus a one-to-one correspondence between the 
elements of the orthonormal set S and the elements of a subset of the 
countable set (y,). This proves the theorem. 


Theorem 3.2-F. Let u,,---, u, bea finite orthonormal set in the space 
X, and let M be the subspace of X generated by u, ^^, Up Then t, >>>, 
u, is a basis for M, and the coefficients in a representation x = £u, +--+ 
+ £u, of an element of M are related to x by the formulas é = (x uj. 


PROOF. If x = ju + --- + Eun then 
(x, uj) = E(u, u;) Fora E (Uns u;) = 2 


by the orthonormality relations. If x = 0 it follows that é =--- = é 
= 0. Hence we see that the u,’s form a linearly independent set and, 
hence, form a basis for the subspace which they generate. 


Theorem 3.2-G. Suppose X is complete, and let {un} be a countably 
infinite orthonormal set in X. Then a series of the form 2 é,u, is convergent 


if and only if > |é,|2 < oo, and in that case we have the relations 


oo 


é, = (it), x= Ett, 


between the coefficients £, and the element x defined by the series. 
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PROOF. Let s, = Ég +--+: b Ea, Then, if m «m, the ortho- 
normality relations and the relation between the norm and inner product 


lead to the formula 
n 2 n 
> £u; = > \é,|2. 


i=m+1 i=m+1 


|S = Smll? = 


Since X is complete, it is now clear that the sequence {s,} is convergent 
e 

in X if and only if > |&|? < oo. If this latter condition is satisfied, and 
1 


if x = lim s, we prove that é; = (x, uj) as follows: By Theorem 3.2-F 


> 
we know that £, = (s,,4;)if1 <i <n. Buts,— x and hence (s, uj) > 
(x, u;) when n — oo, by the continuity of the inner product. Therefore 
£j = (x, u;). This completes the proof. 
The Riesz-Fischer theorem in the theory of Fourier series is a concrete 
instance of Theorem 3.2-G. This theorem asserts that, if a9, a), a), °°: 
and b,, bz, - - + are sequences of real constants such that 


ap x 
ao D (a + bà) < c, 


there exists a function x of class #2(0, 27) having a, and b, as its Fourier 
coefficients, i.e., 


2n 2n 
a, = : Í x(t) cos nt dt, bn = H Í x(t) sin nt dt. 
T JO T JO 


We take X to be L(0, 27) and for ui, uz, ts, U4, Us, >» the elements of 
X corresponding to 


H cos t sin t cos 2t sin 2! 


The coefficients é, £4, -- - in Theorem 3.2-G are related to the standard 
Fourier coefficients by the formulas 


& = ao V v]2, f= a,V7, é; = by vm, sue 


If x is orthogonal to each element of a set S, we say that x is orthogonal 
to S, and write x | S. Since the inner product is continuous, it follows 
that if x | y, and y, — y, then also x | y. Also, if x | y and x | z, 
then x | (y + z) and x | (ay) for every scalar «. Hence, if x | S, then 
x is also orthogonal to the linear manifold generated by S, and to the 
closure of this linear manifold. 


Theorem 3.2-H. Let S be an orthonormal set in the space X. If S is 
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infinite, assume further that X is complete. For each x € X there is an 
element of X unambiguously defined by 


Xs = p; (x, uju. 


ues 


Let M be the closed manifold generated by S. Then x € M if and only if 
x = xs. In any case, xg € M and (x — xs) L M. 
PROOF. If x X, we know by Theorem 3.2-D that (x, u) # 0 for at 


most a countably infinite number of elements u € S. If we index the v's 
for which (x, u) Æ 0, in some arbitrary order, say uj, uz, * : -, the series 


> (x, u,)u,, if infinite, is "convergent (by Theorems 3.2-D and 3.2-G). 


Mottdei the series remains convergent, no matter how its terms are 
rearranged, as may be seen by the first part of the proof of Theorem 


3.2-G, using thë fact that the series > |(x, u,)|2 is absolutely convergent. 


We may then show that the series p (x, u,)u, converges to the same 


n 
element, no matter how the terms are rearranged. For, if {v,} is a 
rearrangement of (4,), and 


X% = 2 (x, Un)Uns X) = > (x, Un)Uns 
n n 


we have (x,, u,) = (x, u,) and (xo, v,) = (X, 0,), by Theorem 3.2-G. 
Thus, if 4, = Vme we have (x, — X2, Un) = (Xi, Un) — (X2, Un) = (X, up) — 
(X2, Um) = (X, Up) — (X, Vme) = X, Un) — (X, Un) = 0, and from this it 
follows, on setting «, = (X, u,), B, = (X, Vn), that 


[lxi — xal? = (^ — X» > Ou, = > Pats) 
= > GA(X, — Xo, Up) — > B — Xa, Up) = 0, 


whence x, = x). These considerations show us that the notation 


> (x, uju has an unambiguous meaning and defines an element which we 
ueS r 

denote by xs. Evidently xs €e M. To prove (x — xs) | M it suffices to 
prove (x — xs) | S. Let v be an arbitrary element of S. Then 


(x — xg, v)= (x, v) — > (x, uXu, v) 


ues 
za (x, v) — (x, v) =0, 
and hence (x — xg) | S. 
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Since x; € M, it remains only to prove that x; = x if xe M. Now, if 
x € M, then x — xs € M, and since (x — xs) L M, we have 


[x — xsl? = (x — Xs, x — Xs) = 0, 


whence x = xg. Itis clear from a scrutiny of the proof that we need not 
assume the completeness of X if S is a finite set, for in that case no con- 
vergence questions arise, and the linear manifold generated by S, being 
finite dimensional, is closed. 


Definition. An orthonormal set S in the space X is called complete 
if there exists no orthonormal set of which S is a proper subset. In other 
words, S is called complete if it is maximal with respect to the property 
of being orthonormal. 


Theorem 3.2-1. Every inner-product space X having a nonzero 
element contains a complete orthonormal set. Moreover, if S is any ortho- 
normal set in X, there is a complete orthonormal set containing S as a 
subset. 


PROOF. Let S be an orthonormal set in X. Such sets certainly exist; 
for instance, if x # 0, the set consisting merely of x/||x|| is orthonormal. 
Let P be the class of all orthonormal sets having S as a subset. It is 
easily verified that P satisfies the conditions of Zorn's lemma (§ 1.7). 
Thus P contains a maximal member. 


Theorem 3.2-J. Let S be an orthonormal set in X, and let M be the 
closed linear manifold generated by S. If M = X, it follows that S is 
complete. If the space X is complete and the orthonormal set S is complete 
(i.e., maximal), then M — X. 


PROOF. If Sis not complete, there exists some x # 0 such that x | SS, 
and hence also x | M. Now, if M = X, we have x | x, which implies 
x —0. Thus, if S is not complete, we must conclude that M # X. This 
proves the first part of the theorem. Let us now assume that X 1s com- 
plete. Then, if M zx X, suppose x eX — M and construct xs as in 
Theorem 3.2-H. Then let 

X — Xs 
MEET 
Then the set consisting of S and y is orthonormal, and y ¢ S, so that S 
cannot be complete. This completes the proof. 

The assumption that X is complete in the second part of the theorem 
is essential, for it has been shown by an example that, if X is incomplete, 
it can happen that there is no orthonormal set in X such that the closed 
linear manifold generated by the set is all of X (see Dixmier, 2). 


$3.2) TOPOLOGICAL LINEAR SPACES s 115 


Example of a complete orthonormal set. We have already mentioned 
the orthonormal set composed of ej, €2,€3, + + in the space I7. This is a 
complete orthonormal set, as we now prove. If x = {é} let x, = ée; + 
e Ée, Then 


Ie xP- dd 


k=n+1 


and so ||x — x,|| — 0. It follows that the closed linear manifold generated 
by the elements e}, ej, --- is all of 72. Hence, by Theorem 3.2-J the 
orthonormal set is complete. In this example we observe that 
én = (x, e,) and hence that 


[||| = 2: |x, e). 
n=! 


In the next theorem we see that this formula is a special case of a relation 
which is characteristic of complete orthonormal sets, provided we deal 
with complete spaces. 


Theorem 3.2-K. | Let S be an orthonormal set in X. Suppose that 
(3.2-8) lxi? = > Ios oP 
ueS 


for every x e X. Then S is complete. On the other hand, if we assume 
that. X is a complete space and that S is a complete, orthonormal set, it 
follows that (3.2-8) holds true for every x € X. 


PROOF. If S is not complete, there exists some x # 0 such that x | S. 
But (3.2-8) then gives |x|? = 0. This proves the first assertion. Now 
suppose that X is complete (as a metric space) and that S is complete (as 
an orthonormal set). For each x € X there is some finite or countable 
set {u,} in S such that 


E > (x, uju = > Mn» Én = (X, up). 


ues n 


Here we use Theorems 3.2-H and 3.2-J. Now 


ixi? = (2 Entin > Enin) = > > e, uus Um) = > Sales 


by the orthonormality relations. The equality just obtained is equivalent 
to (3.2-8). 
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The equality (3.2-8) is called Parseval’s formula. The inequality 


(3.2-9) >, ies OP < IP, 


ues 


which holds for all orthonormal systems, complete or not (see Theorem 
3.2-D), is called Bessel’s inequality. 

The same method which was used to derive (3.2-8) may be used to 
prove Parseval’s formula in the more general form 


(3.2-10) G5») = > & WW, 


ues 


where S is a complete orthonormal set, and x, y are arbitrary elements 
of X. It is assumed that X is a complete space. 

There is an important constructive process for obtaining an ortho- 
normal set from a finite or countable linearly independent set. 


Theorem 3.2-L. Suppose {x,} is a finite or countable linearly inde- 
pendent set. Then, there exists an orthonormal set having the same 
cardinal number and generating the same linear manifold as the given set. 


PROOF. Certainly x; #0. We define y, yo, ++: and uj uy, +: 
recursively, as follows: 
JA 
mar ^ 7 ini 
y, = X2 — (X2, uu u2 = TERT 
nel = Xni Z Qaa; Ukk Unyi = y 
ket Yn 


The process terminates if the set of x's is finite. Otherwise it continues 
indefinitely. It is clear by induction that u, is a linear combination of 
Xis ***, X,, and vice versa. Thus, the linear manifold generated by the 
ws is the same as that generated by the x’s. Observe that y, # 0, because 
the set x4, ---, x, is linearly independent. By direct calculation we see 
that (Yn uj) — 0 ifi — 1, ---, n. From this it follows that the ws 
form an orthonormal set. 

This process of constructing the ws from the x's is called the Gram- 
Schmidt orthogonalization process. 

For a finite-dimensional space we obtain the following result: 
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Theorem 3.2-M. Jf X isa space of finite dimension n > 1, it has a 
basis which is an orthonormal set. Moreover, every complete orthonormal 
set in X is a basis. 


PROOF. If x;,-+-, x, is any basis of X, the Gram-Schmidt process gives 
us an orthonormal basis uj, ---, u, An orthonormal set is linearly 
independent, as we saw in the proof of Theorem 3.2-F. It follows from 
Theorem 3.2-J that a complete orthonormal set in X is necessarily a basis. 


Theorem 3.2-N. Suppose X is infinite dimensional and separable 
(though not necessarily complete). Then, there exists in X a countable 
complete orthonormal set S such that the closed linear manifold generated 
by S is X. 


PROOF. Since X is separable, there exists a countable set {x,} which is 
everywhere dense in X. Let y, be the first nonzero element in the 
sequence {x,}, y; the first x, which is not in the linear manifold generated 
by yı, and y,,, the first x, which is not in the linear manifold generated 
by Y+ y, tis clear that the x's and the y's generate the same linear 
manifold and hence the same closed linear manifold. This manifold is 
the whole space X, because the set of x’s is dense in X. Applying the 
Gram-Schmidt process to the y's, we obtain an orthonormal set which 
generates the closed linear manifold X and which must therefore be 
complete, by the first part of Theorem 3.2-J. The orthonormal set 
cannot be finite, since X is not finite dimensional. 

The assumption in Theorem 3.2-N that X is separable is essential, 
even if we omit the word ‘‘countable” in the conclusion. This can be 
shown by an example; see the remarks following the proof of Theorem 
3.2-J. 


Theorem 3.2-O. Let X be an inner-product space, and let S, and S; 
be two complete orthonormal sets in X. Then S, and S, have the same 
cardinal number (i.e., there is a one-to-one correspondence between the 
elements of S, and S3). 


PROOF. Suppose that one of the sets Sj, S5, say Sj, is finite, and let 
M be the closed linear manifold determined by Sı. Then M = X, for 
otherwise the set S, would not be complete, as we can see readily with the 
aid of Theorem 3.2-H. Hence X is finite dimensional. But then S, and 
S» are both bases for X, by Theorem 3.2-M, and the sets S,, S; must both 
have the same finite number of elements. For the remainder of the proof 
we therefore assume that S, and S; are both infinite sets. For each 
x € S, let S;(x) be the set of those elements y € S; such that (x, y) # 0. 
We know by Theorem 3.2-D that S(x) is an at most countably infinite 
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set. If y © S,, then |iyi| = 1, and it follows from the completeness of S; 
that there is some x € S, such that y € S;(x) (since otherwise S, together 
with y would be an orthonormal set). Hence we see that 


(3.2-11) Sa = J sm. 


xeS$i 


Now let 441, A, be the cardinal numbers of the sets S,, S, respectively, 
and let Ag be the cardinal number of the set of positive integers. The 
relation (3.2-11) shows that 4; < A4g4,. But it is known that, if A is 
any infinite cardinal number, then 494 = A (see, for example, Sierpinski, 
1, $103). Thus, we see that A, < A4,. So far we have used only the 
completeness of S,. If S, is also complete, we can exchange the roles of 
S, and S, and so conclude A, < A,. But then A, = A>, and the proof 
is finished. 


PROBLEM 


If X is a complex complete inner-product space, there exists an operator C of 
the following sort: The domain of C is X, the range of C is in X, and C has the 
. properties 

C(x + y) = Cx + Cy, C(ax) = &Cx, 

C2x = x, iCxl| = [Pll 
Such an operator may be called a conjugation of X, and the notation x = Cx is 
appropriate. The further property (Cx, Cy) = (x; y) may be deduced, using 


(3.2-4) and (3.2-5). Furthermore, the range of C is all of X, and C has the 
inverse C^! = C. To obtain such an operator, let S be a complete ortho- 


normal set in X, and if x — S u)u is the representation of x, let 


ues 
€x = > Guy. 


ues 


3.21 Hilbert Spaces 


Definition. An inner-product space which is infinite dimensional 
and complete is called a Hilbert space (real or complex, according to 
whether the scalar field is real or complex). If X is a finite-dimensional 
inner-product space, we shall call it a Euclidean space. 


In the early literature on Hilbert spaces, it was usual to assume 
separability as part of the definition of a Hilbert space, and separability 
was used in proving some of the most important theorems. But it was 
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subsequently discovered that these theorems could be proved without the 
hypothesis of separability, and the current practice is to invoke this 
hypothesis when it is needed, but not otherwise. 

Some writers have used the adjective Euclidean for any complete inner- 
product space, or even for incomplete inner-product space. Also, complex 
inner-product spaces of finite dimension are frequently called unitary 
spaces. 

An incomplete inner-product space X, being a normed linear space, 
can be completed in the manner described in § 3.13. Moreover, if Y is 
the completion of X, we can define an inner product on Y.x Y by 


(y, Z) = lim (Xn, Up), 


where y, z are equivalence classes of Cauchy sequences from X containing 
{x,} and {u,}, respectively. The existence of the limit defining (y, z) 
may be seen with the aid of the formulas (3.2-3)-(3.2-5). We leave it 
for the reader to take care of the details of showing that (y, z) has all 
the requisite properties of an inner product. We see then that any 
incomplete inner-product space X can be extended to form a Hilbert space 
in which X is everywhere dense. Because of this fact, an incomplete 
inner-product space.may be descriptively called a pre-Hilbert space. This 
terminology has been used by a number of writers. : 

We now give some theorems about concrete representations of Euclidean 
and Hilbert spaces. 


Theorem 3.21-À. Every Euclidean space X of finite dimension 
n(n > \) is congruent to I2(n). 


PROOF. For the definition of congruence see §3.1. We can choose 


for X an orthonormal basis u,,---, u, Then, if x = £u +--+ + Eats, 
the correspondence x +> (£i, - - -, é) establishes the congruence of X and 
P(n) The isometric character of the correspondence follows by direct 
calculation, for, if y = nyu, +--+ + qu, we have 

(x, y) = £i qeu m 
Hence 

ixl = (A2 + +++ + 16l, 
and the right member of this equation is the norm of (é, ---, é) in 
12(n). ; 


It is interesting to observe that, if two inner-product spaces X and Y 
are congruent and if T is the operator which maps X isomorphically and 
isometrically onto Y, we not only have ||Tx|| = ||x], but also (Tx, Tx;) = 
(X1, x2), for every pair x,, x; in X. That this is so follows directly from 
formulas (3.2-3)-(3.2-5). 
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Theorem 3.21-B. Let X be a separable Hilbert space. Then X is 
congruent to l2. 


PROOF. We know (Theorem 3.2-N) that X contains a countable 
complete orthonormal set {u,}. If x€X, let £, =(x,u,). Then the 
sequence {€,} belongs to /? and 


Ix? = > e 


n=] 


by Parseval’s formula (3.2-8). Moreover, every {€,} 6/2 arises from 
some xexX in this way, by Theorem 3.2-G. The correspondence 
x «o {€} clearly establishes an isometric and isomorphic correspondence 
between the elements of X and /2, so that these spaces are congruent. 

In order to get a result like that of Theorem 3.21-B for nonseparable 
Hilbert spaces we must first construct a space somewhat like /2, but of 
such a character that it need not be separable. 


Definition of the Space P[Q]. Let Q be any nonempty set of 
elements. Let P[Q] be the class of all complex-valued functions x 
defined on Q such that the set of q e Q for which x(q) # 0 is either finite 
or countable and, moreover, 


> axo < o. 


qeQ 


This class becomes a complex inner-product space if we define x + y and 
«x as usual with functions and define the inner product by 


(x, y) = > x(q) x(q). 
qeQ 

Moreover, the space is complete. This is clear if Q is a finite set with 
n elements or if Q is countable, for in these cases /2[Q] is congruent to 
(n) and to l? respectively (in fact /2[Q] is /2(n) if Q is the set of integers 
l, ---, n and P[Q] is 7? if Q is the set of all positive integers). If Q is 
uncountable, the fact that /?[Q] is complete follows readily from the fact 
that 7? is complete (see § 3.13). 

We have defined the complex space /2[Q]; it is clear that, if we require 
all the functions x to be real-valued, we get a real inner-product space. 


Now, for each pe Q let x, be the function defined by x(q) = 0 if 
P * q,X(p) — 1. The set of all the x,’s is an orthonormal set; clearly 
its cardinal number is the same as that of the set Q. Hence, by Theorem 
3.2-E, P[Q] is not separable if Q is uncountable. The orthonormal set 
formed by the x,’s is complete. For, if x e /?[Q], the definition of the 
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inner product shows that (x, x,) = x(p), and thus, by the definition of 
the norm, 
Ix? = > qos xp. 
peQ 
Therefore the orthonormal set is complete, by Theorem 3.2-K. 


This example shows that there exist Hilbert spaces having complete 
orthonormal sets whose cardinal number is any specified infinite cardinal. 


Theorem 3.21-C. Let X be a Hilbert space for which the cardinal 
number of any one (and hence of every) complete orthonormal set is A. 
Let Q be any set the cardinal number of whose elements is A. Then X is 
congruent to 12[Q]. 


The proof is just like that of Theorem 3.21-B. 


3.22 The Completeness of Certain Orthonormal Sets 


Example |l. It was mentioned in $3.2 that the functions (1/-/2z)eint 
n — 0, + 1, + 2, -- - determine an orthonormal set in the complex space 
L?(0,2-). It is a fact of paramount importance in the theory of Fourier 
series that this orthonormal set is complete, i.e., that, if 


20 
f x(Neim dt = 0 
0 


for all integers n, then x(r) =°0. For a proof see Zygmund, 1, § 1.5. 
By Theorem 3.2-K the completeness also finds its expression in the 
Parseval relation 


I f” 2h — S 2 
(3.22-1) x | xt)? dt = 2, lel 


n=% 


where 
1 (7 ; 
pe f x(t)e-" dt. 
2« Jo 
The real functions 
(1/V2m),  (I/Vm)cost, — (1/ V/v) cos 2t, 
(1/vm)sint, — (I/V/s) sin 2t, 


also form a complete orthonormal system. The Parseval relation here 
(for real functions), in terms of the usual Fourier coefficients, is 


(3.222) f - {x(t)}2 dt = er * 2. (a,2 + b,2). 
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Example 2. In the space L(— oo. oo) one example of a complete ortho- 
normal system is furnished by the elements corresponding to the Hermite 
functions, which are defined in terms of the Hermite polynomials. These 
polynomials are 


H,(t) = (= Ire? = Pe. fA AO lanes 


and the Hermite function V, is defined as 
b(t) = (Xin! VTH (e-?/2, 


The fact that the ,'s are pairwise orthogonal is a consequence of the 
fact that 


Pnr O — P) = — Qn + DG. 


For proofs that the ¢%,’s form a complete orthonormal set see Wiener, 1, 
page 64, and Achieser and Glasmann, 1, pages 27-28. 


Example 3. Another interesting example is that of the Laguerre 
functions 


¢,(t) = — Lt), n=0,1,2,--- 
where 


LAD = et (ire) 


is the Laguerre polynomial of degree n. The functions {¢,} determine a 
complete orthonormal system in the space L7(0, oo). See Courant and 
Hilbert, 1, volume I, page 81; this proof shows that the closed linear 
manifold determined by the functions {¢,} contains all the elements of 
L(0, oo) corresponding to piecewise continuous functions in #2(0, oo). 
Since elements of L2(0, oo) corresponding to functions of this latter type 
are dense in L?(0, oc) it follows by Theorem 3.2-J that the Laguerre 
functions determine a complete orthonormal system. 


Example 4. The Legendre Macs of degree n may be defined as 


PAD = gi Ze ly. 
The functions 
{Vn + 4 PO} n=0,1,2,--- 
determine a complete orthonormal set in the space L*(— 1,1). The 


argument in Churchill, 1, pages 185-186, can be modified so as to prove 
this assertion. 


$3.3 TOPOLOGICAL LINEAR SPACES 123 


We shall see later on (see Theorem 6.4-D and the latter part of $ 5.5) 
that certain types of integral equations lead to the determination of 
complete orthonormal sets. This situation occurs, in particular, when 
certain types of boundary value problems for differential equations are 
recast as problems of integral equations (see § 6.41). 


3.3 Topological Linear Spaces 


The general definition of a topological linear space was given in § 3.0. 
In this section we give a rather brief discussion of such spaces, with 
emphasis upon the way in which the topology is determined by systems 
of neighborhoods of 0. Throughout the section X denotes a topological 
linear space. 

The principal theorems are 3.3-E, 3.3-F, and 3.3-G. The first two of 
these theorems are concerned with fundamental aspects of systems of 
neighborhoods of 0 in a topological linear space; the third theorem 
brings out the important fact that in a topological linear space the weak 
T,-separation axiom implies that the space is a Hausdorff space (and even 
somewhat more than this). 

One important preliminary comment is this: The function f defined by 
f(x) = ax + xq, where « and x are fixed, is continuous. Moreover, if 
« Æ 0, then fis a homeomorphism of X onto all of X. It therefore maps 
open sets onto open sets. In particular, if S is a neighborhood of 0, 
f(S) is a neighborhood of Xp. 

If S, S,, S; are sets in X, B is a set of scalars, xo is a fixed vector and 
« is a fixed scalar, we write 


Sy + Sy = (x1 + xxi E S1, X2 E S2}, 
Xo + S = {xo + x: x ES}, 
BS = (gx:ge B, xe S}, 
«S = {ax:x E S}. 
Since S, — S, is regularly used for set-theoretic difference, it is necessary 


to distinguish carefully between Sı — S; and S, + (— 1).S;. We do 
denote (— 1). S by — S, however, when this symbol stands alone. 


Definition. A set S in X is called symmetric if x € S implies — x € S, 
i.e., if — S C S. This is equivalent to — S = S. 

Every neighborhood U of 0 contains a symmetric neighborhood of 0, 
eg, UN (= U). 


Definition. A set Sin X is called balanced (in the Bourbaki books the 
term is équilibré) if ES < S, where E is the set of all scalars « such that 
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je] € 1. If T is any nonempty set in X, the set ET is balanced. It is 
called the balanced hull of T. A balanced set coincides with its balanced 
hull. 


The intersection of balanced sets is balanced. The balanced hull of S 
is the intersection of all balanced sets which contain S. 

Observe that a balanced set is symmetric and contains 0. 

The three following theorems are stated formally for purposes of later 
reference. 


Theorem 3.3-A. Let V be a base at 0 in X. Then, the family of sets 
Xo + U, U varying over Y, is a base at x. 


The simple proof is left to the reader. 


Theorem 3.3-B. f 4 is a base at 0 and Ue &, there exists V € U 
such that V+ V c U. 


PROOF. Use the facts that 0 + 0 = O and that addition is continuous. 
We omit the details. 


Theorem 3.3-C. Jf S is a neighborhood of 0, the balanced hull of S 
is open. 


The simple proof is left to the reader. It may be observed that, if S 
is open but does not contain 0, the balanced hull of S may not be open. 
However, if the point 0 is deleted from the balanced hull, the set which 
remains is open. l 

The following theorem shows that there exists a family of balanced 
neighborhoods of 0 constituting a base at 0. 


Theorem 3.3-D. Jf% is a base at 0 and Y^ is the family of balanced 
hulls of the members of U, then Y^ is a-base at O. 


PROOF. Suppose Ue 4. From0-0 = 0 and the continuity of products 
it is possible to obtain a neighborhood of 0, say W;, whose balanced hull 
W, is contained in U. Since W, is a neighborhood of 0 (by Theorem 
3.3-C), there exists U; € 4 such that U, c W;. If V is the balanced 
hull of U;, we have V € W, and hence V — U. This completes the 
proof. 


Definition. A set Sin X is called absorbing if to each x € X corresponds 
some e > 0 such that ax e Sif 0 < |a| < «. An equivalent formulation 
is: S is absorbing if to each x € X there corresponds some r > 0 such that 
xeaSif|e| 2 r. 

It is clear at once from the continuity of products and the fact that 
0-x = 0 for every x that each neighborhood of 0 is absorbing. 
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The concepts of balanced sets and absorbing sets do not require a 
topology for their definition; they make sense in any linear space. As 
we shall presently see, a suitable family of balanced and absorbing sets in 
a linear space can be used to define a topology for the space. 

A balanced set S is absorbing if and only if to each x € X there 
corresponds some « Æ 0 such that «x € S. 


Theorem 3.3-E. If X is a topological linear space, there exists a 
family U of open sets forming a base at 0 and having the properties: 


1. Each member of the family is balanced and absorbing. 
2. If U € t and a #0, then aU e U. 
3. If UEY, there exists V € & such that V + V c U. 


PROOF. Let 4 be the family of all balanced neighborhoods of 0, which 
is the same as the family of balanced hulls of al neighborhoods of 0. 
We leave the verification of properties 1-3 to the reader. 

In a normed linear space X the sets (x:|xl| < r}, r varying over all 
positive numbers, form a family with the properties specified for Y in 
Theorem 3.3-E. In proving theorems about topological linear spaces, 
a base with these properties is frequently used to pattern arguments after 
proofs using norms. 

The next theorem shows how a topology may be constructed for a 
linear space. 


Theorem 3.3-F. Let X be a linear space. Let & be a nonempty 
family of nonempty subsets of X with the following properties: 


1. Each member of U% is balanced and absorbing. 

2. If U e &, there exists Ve & such that V+ VC U. 

3. If U, and U, are in X, there exists U, € U such that U € U, O Uh. 
4. If U € & and x € U, there exists V € & such that x + V — U. 


Then there is a unique topology for X such that X is a topological linear 
space with Y as a base at 0. — 


PROOF. A nonempty balanced set contains 0. Hence x € x + U for 
each UE 4. We shall define a set S to be open if to each x € S there 
corresponds some Ue Y such that x + Uc S. The elements of X are 
open, by (4), and (3) shows that the intersection of two open sets is open. 
The class of open sets, as defined, obviously has the remaining properties 
required in order for it to be a topology for X. The set 4 is evidently 
a base at 0. 

The fact that addition is continuous follows at once from (2). Before 
proving continuity of multiplication we observe the following: 


5. If U € U and « # 0, there exists V € Y such that «V — U. 
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To prove this we observe by (2) and induction that, if Ue Y and n is 
any positive integer, there exists V € Y such that 2^"V — U. Now consider 
U and « in (5). Choose n so that |a| < 2", and V € X so that 2^V c U. 
Since U is balanced it is readily seen that «V — U. Thus (5) is proved. 

Now suppose that «g and x are fixed. We shall show that, if U € Y 
there is a V € W and an e > 0 such that ax € agxo + U if |a — al < € 
and x € xy + V. Choose Win X so that W + W + Wc U [by double 
use of (2) and observing that O € W]. If «y = 0, let V = W; if ag 4 0, 
choose W, € € so that «oW, = W [by (5)], and then choose V € X so that 
Vc WW, By (1) there is some e > 0 such that £xo € V if |B| < e. 
We can assume that e <1. Now suppose that |« — a| < e and 
X€Xxo +V, or x —^x9€ V. We know that (« — «g)xo € V, and 
(« — «(x — xg) € V as a result of the fact that V is balanced. Finally, 
«(x — xg) € ag c W. Consequently, from 

«X — «gXg = (a — eg)xg + ag(X — xg) + (a — egY(x — xo) 
we see that «x — agxo € W + W + Wo U. This completes the proof 
that multiplication is continuous. 

The uniqueness assertion in Theorem 3.3-F follows from Theorem 
3.3-A and the fact that a base determines its topology uniquely. 

The definition of a topological linear space makes no provision for 
separation axioms. Thus, the space need not be a 7,-space. Consider, 
for instance, a linear space X having more than one point, with Ø and X 
as the only open sets. The next theorem shows, however, that a Tj- 
topological linear space must necessarily be a 73-space, and so, in 
particular, a Hausdorff space. 


Theorem 3.3-G. 4 topological linear space is regular. Hence, if it 
is a T,-space, it is also a Hausdorff space. 


PROOF. Regularity is defined in § 2.3. We choose a base X at 0 
having the property 3 in Theorem 3.3-E. Suppose U, Ve% and 
V + Vc U, and suppose x e V. Now x  (— 1)-V is a neighborhood 
of x, and therefore (x + (— 1): V} AV x90. Suppose ye (x + (-1)-V} 
A V,and writey = x —-z zeV. Thenx=y+zeEV+VcC U. This 
proves P c U. The complete proof of the theorem now follows from 
Theorem 3.3-A and the fact that the closure of a set x + V is x + V. 

It is also true that a topological linear T;-space is completely regular 
(definition in $2.3). For a proof of a somewhat more general result 
which is easily rephrased for the present situation, see Weil, 1, page 13. 


Definition. Two topological linear spaces X and Y are called 
topologically isomorphic, or linearly homeomorphic, if there exists a linear 
operator T which establishes a homeomorphic mapping of X onto all of Y. 
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Are all n-dimensional topological linear spaces with the same scalar 
field linearly homeomorphic to one another (and so in particular to 
12(n))? Not necessarily so, for, if X is n-dimensional, we may give it the 
topology in which the only open sets are Ø and X, and then it is certainly 
not homeomorphic to /2(n). However, this anomalous situation is 
avoided if we deal with 7,-spaces. 


Theorem 3.3-H. A/ n-dimensional topological linear T,-spaces with 
the same scalar field are linearly homeomorphic. 


This is a generalization of Theorem 3.12-A. The proof is left for the 
problems at the end of the section. 

Since the concept of distance is not available to us in discussing the 
general theory of topological linear spaces, the concept of a bounded set 
must be defined in a manner different from that for metric spaces. 


Definition. In a topological linear space a set S is said to be bounded 
if for each neighborhood .U of 0 there is some scalar « such that S c aU. 

In view of the fact that there exists a base at 0 composed of balanced 
neighborhoods, we may say "some positive scalar œ” instead of “some 
scalar «," and the modified definition is equivalent to the original. 


It is clear that a subset of a bounded set is bounded. 

In the particular case in which the space is a normed linear space, the 
foregoing definition is easily seen to be equivalent to the definition of 
boundedness in terms of the norm; that is, S is bounded if and only if 
there is some positive 8 such that ||x|| < 8 for each x in S. 

The concept of boundedness is important in connection with the 
question of whether a topological linear space is normable (see Theorem 
3.41-D). Í 

In this book no extensive use is made of the general theory of topological 
linear spaces. Apart from normed -linear spaces, the topological linear 
spaces studied in this book are mainly those which arise from the intro- 
duction of “weak topologies” into normed linear spaces. However, the 
general theory is a subject of growing interest, and much research is 
being done on it. 


PROBLEMS 


1. To prove Theorem 3.3-H it suffices to show that an n-dimensional topo- 
logical linear T,-space X is linearly homeomorphic to (n). If we write 
x = éx +--+ + ÉpXn where xi, +--+, x, is a basis for X, the main difficulty 
lies in proving that the point (£i, ---, én) of (n) depends continuously on x. 
The following suggestions should enable the reader to make the proof. If 
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e > Ois given, let K be the set of points in /2(n) for which |£,|? + --- + |£,|? = €, 
and let S be the corresponding set in X. The fact that X is a T;-space is used 
in proving that S is closed. It is possible to choose a balanced neighborhood 
of 0 in X, say U, such that U © S = 0. One can then show that x € U implies 
Merl? + ER < eL 

42. If X and Y are topological linear spaces and X is a finite-dimensional 
T,-space, every linear operator on X into Y is continuous. 

.3. A set T is said to absorb a set S if there is some r > 0 such that SC aT 


when |a| > r. Show that a set S is bounded if and only if each balanced 
neighborhood of 0 absorbs S. 


»4. A set S is bounded if and only if it has the following property: If {a,} is 
a sequence of scalars such that o, — 0 and if {x,} is a sequence of elements of 
S, the sequence (a,x,) is convergent to 0. 

5. Let X be the linear space of real-valued functions x which are defined and 


continuous on the real axis. Corresponding to each « > 0 and each compact 
set S of real numbers, let 


U., s = {x:|x(s)| < eifs eS). 


As « and S vary, the family % of the sets U. 5 satisfies the conditions 1—4 of 
Theorem 3.3-F, and hence is a base at 0 for a topology on X, making X into 
a topological linear space. Is it a 7;-topology ? 

«6. On occasion it is useful to have an alternative to Theorem 3.3-F for the 
construction of a topological linear space. Here is such an alternative. Let X 
be a linear space, and let Y^ be a nonempty family of nonempty sets with the 
following properties: 


a. Each W in * is balanced and absorbing. 
b. If W, and W, are in W, there exists W; € W such that W3 c W1 O Wa. 
c. If W, € W, there exists W, e W such that Wz + W; € W.. 


Let a set S in X be defined as an open set if to each x € S there corresponds some 
Wew such that x + WC S. With this family of open sets, X is a topological 
linear space. Verification of this assertion is left to the reader. 

If we compare this situation with that in Theorem 3.3-F, we observe that 
property 4 of Theorem 3.3-F is not assumed as a property of the family *. 
Otherwise the situations are the same. As a consequence, we are not able to 
assert that the members of W are open sets. Suppose, for instance, that X is 
the Euclidean plane and that ¥ is the family of sets W, of the form 


W, = (£u &yé? + &? < €), 


where « can vary over all positive numbers. The resulting topology for X is 
the usual topology of the plane. 


7. Consider L^(a, b), where 0 < p < 1. We write 


b l/p 
lxi! = (f |x(s)|? as) j 


just as when p > 1. With 0 < p < illxl is not a norm, for the triangular 
inequality fails to hold. Instead, we have the inequality 


lix + yl < max {2lxli, ily}. 
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However, let W, = (x:üxl| < ej. The family ** of all such sets W,, for all 
€ > 0, satisfies conditions a-c of 6. Hence L? becomes a topological linear 
space if open sets are defined as follows: S is open if to each x € S there cor- 
responds some e > 0 such that y e S whenever ||y — xl] < e. 


8. If X and Y are topological linear spaces, a linear operator T on X into Y 
is continuous at all points of X if it is continuous at some point of X. 


9. There is a generalization of the concept of completeness for a topological 
linear space. Since the topology may not be that of a metric space, it turns 
out to be desirable to use Moore-Smith convergence instead of sequential 
convergence in defining completeness. We rely on the terminology concerning 
directed sets and nets used by Kelley, 1, Chapter 2, in connection with Moore- 
Smith convergence. Suppose X is a topological linear space. A net f in X 
(i.e., a function with range in X and domain some directed set D) is called a 
Cauchy net if for each neighborhood U of 0 in X there is some d, € D such that 
f(di) — f(d;) € U if dy < d, and dy < dọ. The net is said to converge to x if 
for each neighborhood U of 0 there is some dy € D such that f(d) — x eU 
when dọ < d. If a net converges to a point, it is a Cauchy net. If every 
Cauchy net in X converges to a point in X, we say that X is complete. An 
alternative approach to completeness is through the concept of Cauchy filters 
(see Bourbaki, 2, Chapter II). 


a. If X and Y are topological linear spaces which are topologically isomorphic, 
they are both complete if one is. 

b. For a normed linear space the present definition of completeness is 
equivalent to the notion of completeness for metric spaces, as defined in $ 2.41. 

c. Let M be a closed subspace of the topological linear space .X. If Y is 
complete, so is M. If X is a T,-space and if M is complete, it is closed in X, 
regardless of whether XY is complete. For the proof it is necessary to know 
that, if S C X, a point x is in S if and only if there is a net in S converging to 
x. Also, when X is T}, it is also T>, and then a net in X cannot converge to 
two different points. 

d. If X is a topological linear space which is locally compact and 7), it is finite 
dimensional. We sketch the argument. Using the local compactness, we 
obtain a balanced neighborhood of 0, say V, such that Vis balanced and compact. 
Then, for each neighborhood W of 0 we obtain as follows an « # 0 such that 
«V c W. Choose a balanced neighborhood W, of 0 such that W, + W, c W. 
Choose points xj, +--+, x, € Vso that xy + Wi, + © , x, + Wi cover V. Choose 
o; # 0 so that a,x; € W,. Then take « so that |a| < 1 and 0 < jal < minlo;|. 
One can show «Y c W. Since P is compact we can choose y,, +++, »,EV 
so that y, + ! E, --+, y, + I/27 cover V. Let M be the linear manifold 
generated by yi, +*+, y, Evidently VO M + !/;V. Since X is Tj, M is 
topologically isomorphic to /2(m) for some m < n. Hence M is complete and 
therefore closed in X. Finally, M = X. For, assume x9 € X — M. Let A be 
the set of all nonzero scalars «œ such that (xo + «V) ^ M z 0. Then A is not 
empty, as a result of the fact that V is absorbing. Let à = inf |a| for « e A. 
The following argument shows that 5 > 0. Since X — M is open there exists 
a neighborhood W of 0 such that xy + W c X — M. There exists a nonzero 
scalar «, such that e, c W. Then, using the fact that V is balanced, we show 
that « is not in A if 0 < |a| < |:|, and so 8 > |«;]. Now choose « € A so that 
le| « 28 and choose x €(xo + «P) ^ M. Then (x — xy/«e V € M + hV, 
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and so we can write x — «yọ = xg + (a/2)v with yo € M and v.e P. We 
conclude that (a/2) € A, which is a contradiction. Hence M = X and X is 
finite dimensional. 

e. Every finite-dimensional subspace of X is closed if X is a 7;-space. 

10. Let M be a closed subspace of the topological linear space X. With the 
quotient space X/M and the canonical mapping ¢ of X onto X/M as defined in 
§ 3.14, define a set S in X/M to be open if $-!(S) is open in X. This makes 
X|M a topological linear T,-space. If the topology of X arises from a norm, 
this topology for X/M is the same as that generated by the norm defined in 
Theorem 3.14-A. 


3.4 Convex Sets 


Let X be a reallinear space. If x, and x; are distinct points of X, the 
set of all points (1 — o)x, + «x; for which O < « < 1 is called the /ine 
segment joining x, and x;, or simply the line segment xx». 


Definition. A set S in X is called convex if S contains the line segment 
x4X5 whenever x, and x; are distinct points of S. This is equivalent to 
the requirement that, if xı, x; € S, then also ox, + ax, € S whenever 
o4 and a are positive numbers such that o, + œ = 1. 


The empty set and a set consisting of one point are convex, since the 
conditions of the definition are vacuously satisfied by such sets. Notice 
that a linear manifold is convex and that the intersection of a family of 
convex sets is a convex set. 

In a normed linear space an open sphere is a convex set. Likewise the 
closed sphere (x:|ix — xol| < rj is convex. 

The notion of a convex set is independent of topology, but convex sets 
play an important part in the theory of topological linear spaces. The 
first five theorems of this section make no use of topology. The remaining 
theorems involve topological ideas. The student who is interested in 
normed linear spaces, to the exclusion of more general types of topological 
linear spaces, may ignore Theorem 3.4-H. E 

If X is a complex linear space, it can also be regarded as a real linear 
space, and it is this point of view which is taken when we define the 
concept of a convex set in a complex linear space. 


Theorem 3.4-A. Let X be a linear space (real or complex). Let S and 
T be convex sets in X, and let « and B be any scalars. Then the set 
aS + BT is convex. 


We omit the proof, which is immediate. 
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Theorem 3.4-B. Let S be a convex set in X, and let a, B be positive. 
Then oS + BS = (a + B)S. 


PROOF. It is evident that (x + B)S C «S + BS, regardless of convexity. 
If S is convex, and y = wx, + x, where x,, x; € S, then 


- a "en B 
«4 B^ atp! a +g 


X E€ S, 


since 


Thus y € (a + B)S, and «S + BS € (a + B)S. This completes the proof. 


Definition. If S is any set in X, the convex hull of S is defined to be 
the intersection of all convex sets which contain S. We sometimes denote 
it by S,. 


Theorem 3.4-C. The convex hull of S consists of all points which are 
expressible in the form a,x, + +++ + o,x,, where xi, +++, x, are any points 


of S, ax > 0 for each k and > e, = 1. The index n is not fixed. 
k 


PROOF. Let T be the set of points expressible in the manner described 
in the theorem. It is readily seen by the definition of convexity that T 
is convex. Since T clearly contains S, it follows that S, — T. We shall 
show that T is contained in every convex set which contains S. We do 
this by induction on the number of points of S occurring in the repre- 
sentation of a point of T. Let W be a convex set containing S. If 
X = a,x, is a point of T for which n = 1, it is clear that o; = 1 and 
x€S. Let us assume that a point of T is in W if it is represented in 
terms of n — 1 points of S. Then, let x = a,x; t +++ + ex, be in T. 
Let B = o, Toc aas Bk = oB (E = lenn 1), y = fiX; ost 
+ Bn-1Xn-1 Then ye W, by the induction hypothesis. But x, € W, 
«, = | — B, and x = By + (1 — B)x, E W, since W is convex. This 
completes the induction. Thus T C.W, and it follows that Tc Se 
The proof is now complete. 

We shall later on have occasion to deal with sets which are both 
balanced and convex. The concept of a balanced set involves considering 
all scalars « such that |a| < 1. Accordingly, if X is a complex linear 
Space, a set in X which is balanced when complex scalars are considered 
is also balanced when only real scalars are considered and X is viewed 
as a real linear space. But a set may be balanced from this latter point 

` of view and not balanced when complex scalars are considered. To avoid 
confusion, we shall always understand that, when balanced sets are 
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mentioned without explicit mention of the field of scalars under consider- 
ation, the sets are balanced relative to the field of scalars associated with 
the space. 


Theorem 3.4-D. 4 convex set in a real linear space is balanced if 
and only if it is symmetric. 


PROOF. Since every balanced set is symmetric, it suffices to show that 
a convex and symmetric set S is balanced. Suppose xe S. Then 
—x€$S. Hence, since S is convex, (1 — «)(— x) + ax = (2« — Dx is 
inSifO<a<l. Thus £xe S if — 1 < B < 1, and S is balanced, by 
definition. 

Let X be a linear space, either real or complex. If S c X, let S, denote 
the balanced hull of S, and let S, denote the convex hull of S. 


Definition. The set (S5), is called the balanced and convex hull of S. 
We denote it simply by Spe 


Theorem 3.4-E. Jf X is a real or complex linear space, the set Sy, 
consists of all finite sums Xoyx,, where the x,’s are elements of S and 
Xe, <1. S is the intersection of all sets which are both balanced and 
convex and contain S. 


PROOF. Let T be the set described in the theorem. We recall that S, 
is the set of all elements ax, where |æ] < 1 and x eS. If x € Spo we 
know by Theorem 3.4-C that x is a finite sum »f,o,x,, where x, € S, 
le] < 1, B; > 0, and Xf, = 1. It is thus clear that Sj, c T. On the 

„Other hand, suppose x€T7. Then x = £e,x, where x, €S, and 
PLle| < 1. If X|e,| = 0 it is clear that x = 0 € S, and so xe Spe If 
Ddloy| = « # 0, let B, = |o,|/e. Then B; > 0, 28, = 1. We can write 
ey = |ox|y,, where y, is a scalar (real or complex) such that |y,| = 1. 
Lety, = «ey,x,. Thenf,y, = e,x,, and x = 2fyy,  But|ey,| = « < 1, 
SO y, € Sy. Thus x € Sy, by Theorem 3.4-C. We now know that 
T € Spc and therefore that T = Spe. It is clear from the form of the 
elements of T that S,. is balanced. It is of course convex. Verification 
of the last assertion in the theorem is left to the reader. 

It may be remarked that (S,), is not always the same as (Sp). Indeed, 
(S), can fail to be convex. 

Next we consider convex sets in a topological linear space. 


Theorem 3.4-F. Let S be a convex set in a topological linear space. 
Then the closure S is also convex. 


PROOF. Suppose xy, yg € S and O < « < 1. Consider the function 
f(x,y) = (1 — a)x + ay. Itiscontinuous. Let U be any neighborhood 
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of (1 — c)xg + ayo. If we show that U contains points of S, it will 
follow that (1 — o)xo + «yg € S and hence that S is convex. Now, since 
fis continuous, there exist neighborhoods V and W of xy and yo respectively 
such that f(x, y) e U if x e V and y e W. Since xy € S, V contains some 
point x, € S; likewise W contains some point y, € S. Thus, since S is 
convex, f(xi, yj) € S. But f(x, yj) € U also. Thus the proof is com- 
plete. 

If S is any set, the closure of the convex hull of S is called the closed 
convex hull of S. It is the intersection of all closed and convex sets which 
contain S. The sets S and S have the same closed convex hull. 


Theorem 3.4-G. Jf S is an open set, its convex hull S, is also open. 


PROOF. Suppose x € S, then x is a finite sum Yo,x,, where x, € S, 
ey > 0, and Sa, = 1. Since S is open, there exist neighborhoods V, of 
x, such that V, c S. Let T be the set 9o, V,, i.e., the set of all elements 
£e, where v, € V, Clearly x e T € Se, so all that is needed is to 
show that T is open. "Now each oV, is open, since a, #0. Hence T 
will be open, by induction, once we know that U + V is open if U and 
V are open. Now x + V is open for each fixed x, and U + V is the 
union of all x + V as x varies over U. Thus U + V is open. 

The next theorem is used in the proof of Theorem 3.41-D. The result 
would be obvious and a formal statement unnecessary if we confined 
ourselves to normed linear spaces. 


Theorem 3.4-H. Jf X is a topological linear space and U is a convex 
neighborhood of 0, then U contains a balanced and convex neighborhood of 0. 


PROOF. We know from the proof of Theorem 3.3-D that U contains 
a balanced neighborhood V of 0. Let W be the convex hull of V. Then 
W is a neighborhood of 0, by Theorem 3.4-G. Since V is its own balanced 
hull, W is the balanced and convex hull of V and is therefore balanced 
(Theorem 3.4-E). Since U is convex, it follows that W c U. Thus W 
meets the requirements of the theorem. This argument works for both 
real and complex spaces. For real spaces we could obtain a satisfactory 
W by taking W = UM (— U) (see Theorem 3.4-D). 


PROBLEMS 


l. Let S be a convex set in the topological linear space X. Suppose 
Xo € int (S) and yọ € S. Then, every point y expressible in the form y = axọ + 
(1 — ayo, O < « < 1, is an interior point of S. 

2. Under the conditions on S and X in problem 1, the set int (S) is convex. 
If int (S) 4 9, we have int (S) = $ and int (S) = int (5). 


134 INTRODUCTION TO FUNCTIONAL ANALYSIS [§ 3.41 


3. Let A;,---, A, be compact convex sets in the topological linear space X. 
Let A= Aí,U---U Ap Then A, is compact. Begin by showing that A, is. 
composed of all the points x which are expressible in the form x = «jx; + 
+++ + a,x, With x, € Ak, 0 < ay, anda; +°- e, = 1. Then, let P be the 


compact set in /2(n) composed of all points (ej, +++, œp) with a, > 0 and 
a; +-+- +a, = 1. Observe that A, is the image in X of the product set 
P x A, x +++ x A, by the mapping (@1,° ++, €n, Xis ts, X4) — oxi H o + XR. 


4. In a normed linear space X the convex hull of a precompact set S is pre- 
compact. The argument depends on Theorem 2.41-G and problem 3. If 
€ > 0, choose xj, ---, x, in X so that S is contained in the union B of the open 
spheres of radii e/2 with centers xj, --:, x,. Let A be the finite set xj, © * °, xy. 
Show that B, is contained in the union of the open spheres of radii e/2 with 
centers in A.. Then observe that A, is compact and so deduce that S, is 
precompact. 


5. In a Banach space X the closed convex hull of a compact set is compact. 
Use problem 4. 


3.41 Minkowski Functionals 


In this section we assume that X is a real linear space and that K is a 
convex set in X. We assume further that K is an absorbing set and that 
0 c K. 


Definition. For each x € X let A, be the set of those real « such that 
« > 0 and xeaK. Since K is absorbing, A, is not empty. We then 
define 


(3.41-1) p(x) = inf A,. 


The functional p is called the Minkowski functional of the set K. 
Evidently 0 € p(x) < oo. This functional is useful in dealing analytically 
with K. We shall see in §3.7 that there is a close relation between 
Minkowski functionals and seminorms, which are used in connection with 
the topology of certain topological linear spaces. 

If X is a normed linear space and K = {x:||x|| < rj, where r is fixed 
and positive, it is easy to see that p(x) = |Ixlj/r. If K is a closed and 
bounded convex set in Euclidean space of n dimensions, if 0 is an interior 
point of K and x # 0, we can think of p(x) as follows: Let y be that 
unique positive multiple of x in which the ray from 0 through x intersects 
the boundary of K. Then x — p(x)y, and p(x) is the ratio of the distance 
Ox to the distance Oy. 


Theorem 3.41-A. Let K be a convex, absorbing set which contains 0. 
The Minkowski functional of K has the properties 


(3.41-2) pO) =0, piax)=Ap(x) ifA>0 


$3.4] TOPOLOGICAL LINEAR SPACES 135 


(3.41-3) p(x + y) < p(x) + ply). 
If K is balanced, then, for any scalar A, 
(3.41-4) p(Ax) = {Al p(x). 


This last relation holds even for complex ^ if X happens to be a complex 
space and K is balanced in the complex sense. 


PROOF. If x and y are given and a, B are arbitrary elements of A,, A, 
respectively, we have x + y e«K + BK. This last set is (« + B)K, by 
Theorem 3.4-B, and soa + BEA, It follows that p(x + y) < a + f. 
Owing to the arbitrariness of « and £, (3.41-3) now follows. The relation 
p(©) = 0 is evident, since 0 € K. To prove the other relation in (3.412) 
suppose à > 0 and xe X. Take any «€ A4,. Then x € «K, Ax € AeK, 
and so Awe A,,, whence p(Ax) < Ae. By the arbitrariness of a we 
conclude that p(Ax) < Ap(x). Now replace x by Ax and A by A71, thus 
obtaining p(x) < A-!p(Ax), or Ap(x) < p(Ax). Consequently p(Ax) = Ap(x). 
If K is balanced, if à z 0 and xe X, suppose «€ 4,. Then x Eck, 
(A/|Ala)x e K, Ax e |AlaK, p(Ax) < |Ale, and so p(Ax) < |A|p(x). The 
reverse inequality is obtained by the same device as before, and so 
(3.41-4) is proved. 

As a result of (3.41—3) we note the following inequalities, which will be 
used later: 


(3.41-5) — p(y — x) < p(x) — p(y) < pix — y). 


Theorem 3.41-B. Let K be a convex, absorbing set which contains 0. 
If p is the Minkowski functional of K, then p(x) < 1 whenever x € K, and 
P(x) < 1 implies that x e K. 


PROOF. If xéK, then 1€ A, and so p(x) <1. If p(x) « 1, there 
exists « € A, such that 0 < œ < 1. Now, since 0 and «1x are in K and 
K is convex, it follows that «-a-!x + (1 — «)-0 = xe K. 

Next we add the assumption that X is a topological linear space. 


Theorem 3.4l-C. Let X be a topological linear space, and let p be the 
Minkowski functional of a set K in X, where K is convex, absorbing, and 
contains 0. Let K, = (x:p(x) < 1}, Ky = {x:p(x) < 1}. Then 


; int (K) c Kic Kc K;c K. 

. K = K, if K is open. 

K = K, if K is closed. 

. If p is continuous, K, = int (K) and K, = K. 

. p is continuous if and only if 0 € int (K). 

If K is bounded and X is a T,-space, p(x) = 0 implies x = 0. 


We O^ cR 
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PROOF. Suppose x €int(K). Then ax € K when « is sufficiently near 
1, and hence we can find some « > 1 such that ox € K. Then «^! € A, 
and p(x) < a! < 1, so x e Ki. We know K; € KC K, from Theorem 
3.41-B. To prove K, c K it suffices to consider an x for which p(x) = 1. 
Then exe Kc K ifO «o « I. Letting «+1 we see that ax — x, 
whence x e K. We have now finished with (a); (b) and (c) are immediate 
consequences. If pis continuous, K, is open by Theorem 2.12-A ; hence, 
in view of (a), K, = int (K); it also follows that K, is closed and so 
K, = K. We observe that 0 € K,. Then O € int (K) if p is continuous, 
by (d). On the other hand, if 0 € int (K), let U be a neighborhood of 0 
such that Uc int (K). Then p(x) « 1 if xe U. Now, if « > 0, then 
«eU is a neighborhood of 0, and we have p(x) < e if x & «eU, because 
etx e U and p(e-!x) = e-lp(x) < 1. This shows that p is continuous 
at 0. The inequalities (3.41-5) then show that p is continuous at all 
other points (recall that every neighborhood of 0 contains a symmetric 
neighborhood of 0). Finally, suppose that X is a Tj-space and that K is 
bounded. If x # 0, there exists a balanced neighborhood of 0 which 
does not contain x. Let U be this neighborhood. Since K is bounded, 
Kc BU for some B > 0. Now suppose «€ A,. Then x e oK and so 
x/a € BU, or (1/a8)x € U. .Since U is balanced and x is not in U, it follows 
that «8 > 1, for «B < 1 would imply x = ef(l/aB)x € U. But « > 1/8 
implies p(x) > 1/8, and so p(x) » O. This finishes the proof of the 
theorem. 


Definition. A topological linear space X is said to be normable if 
.there exists (i.e., if it is possible to define) a norm on X such that the 
resulting topology for Y as a normed linear space is the same as the given 
topology for X. 


Theorem 3.41-D. 4 topological linear space X is normable if and only 
if (V) X is a T,-space and (2) there exists in X a convex and bounded 
neighborhood of 0. 


PROOF. The conditions are evidently necessary, for a metric space is 
a T\-space, and the set (x:|ix| < 1} in a normed linear space is both 
convex and bounded. Suppose, on the other hand, that X satisfies 
conditions 1 and 2 of the theorem. Let U be a bounded and convex 
neighborhood of 0. There exists a neighborhood V of 0 such that V c U 
and V is balanced as well as convex and bounded (Theorem 3.4-H). Let 
p be the Minkowski functional of V. By Theorem 3.41-A we see that 
p has all the properties of a norm except possibly for the property that 
p(x) # 0 if x ¥ 0, and this property follows by Theorem 3.41-C, part f. 
Thus p is a norm on X 
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We now complete the proof by showing that the topology of X is the 
same as the topology defined on X by the norm p. We know by Theorem 
3.41-C, part b, that V = (x:p(x) < 1}. If a > 0, «V = (x:p(x) < aj. 
It suffices to prove that the family of sets («V (a the parameter) is a base 
at 0 in the given topology of X. Suppose U is any neighborhood of 0. 
There exists a balanced neighborhood of 0, say W, such that Wc U. 
Since V is bounded, there exists some «e > 0 such that V c eW. Thus 
«V c U. This shows that {aV} is a base at 0, and the proof is complete. 


3.5 Linear Varieties 


Throughout this section X denotes a linear space; except where specific 
mention is made of the nature of the scalar field, it may be either the real 
or the complex field. 

The considerations of this section are geometric in character. If we 
suppose that X is Euclidean space of three dimensions, a linear variety is 
either a point, a line, a plane, or the whole space. The general notion 
of linear variety requires merely a linear space for its setting, with no need. 
of considerations of topology or finite dimensionality. The most inter- 
esting linear varieties are those known as hyperplanes. A hyperplane M 
through 0 in X can be characterized in two ways: (1) It is the set of elements 
x such that x'(x) = 0, where x’ is some nonzero linear functional on X; 
(2) it has the property that X can be expressed as the direct sum of M 
and a one-dimensional subspace. 


4 Definition. A set M C X is called a linear variety if M = xo + Mo, 
where x, is a fixed vector and Mọ is a subspace of X. 


We call M a translation of Mp. Note that xo € M, because 0 € My. 
It is easy to see that, if M = xy + Mo and x, € M, then also M = x, + Mo. 
This follows at once from the fact that, if x, and x; are in M, then 
X1— X2E Mo. 

A linear variety is a convex set. A set consisting of a single point is a 
linear variety, for (0) is a subspace. 

A subspace X, of X will be called maximal if it is not all of X and if 
there exists no subspace X, of X such that X # Xj, X; X and Xo Xj. 
A linear variety which results from the translation of a maximal subspace 
is called a hyperplane. In particular, a hyperplane containing 0 is the 
same thing as a maximal subspace. All of the hyperplanes obtained by 
translating a particular one are said to be parallel to this one. 

At this point we recall the notation X/ for the linear space of all linear 
functionals on X (see § 1.6). 
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Theorem 3.5-A. If x’ EX, x' # 0, and « is any fixed scalar, the set 
M = (x:x'(x) = aj is a hyperplane. It contains the origin 0 if and only 
ife = 0. To each hyperplane M containing 0 corresponds an x' € Xf such 
that x + 0 and M = (x:x'(x) = 0}. 


PROOF. Consider the first assertion. Since x’ # 0, there exists x, such 
that x'(xy) 2 8 #0. Let xo = (e/g)xy. Then x'(xj)) = «, so xo € M. 
Let My = — xo + M. It is quickly verifiable that My = (x:x'(x) = 0}. 
Clearly M, is a subspace, and so M is a linear variety. Now My # X. 
If y € X — Mo, every element of X can be written as the sum of an element 
of M, and a multiple of y. In fact, if x € X and 


we see that x'(z) = 0, so that x has the required form. If we now suppose 
that M, is a subspace of X for which M; € M, and M, # Mo, we can 
choose y € M, — Mo. The foregoing argument then shows that X c Mj, 
so that M, — X. This shows that M, is maximal and that M is a hyper- 
plane. Evidently M contains 0 if and only if « = 0. 4 

Now suppose that M is any hyperplane containing 0. Theorem 1.71-B 
shows that there exists an x’ # 0 such that M € (x:x'(x) = 0}. But then 
we must have M = (x:x'(x) = 0); otherwise M would not be maximal. 
This completes the proof. 

In the course of the proof of Theorem 3.5-A we obtained the following 
result: ° 


_.» Theorem 3.5-B. Suppose x' X7, x’ #0, and M = {x:x'(x) = 0}. 
Then, if xy € X — M, every x € X can be expressed in the form 
x'(x) 


(3.5-1) x= xx) 


Xo + m, m e M. 


This is a convenient place at which to insert the following useful theorem: 


Theorem 3.5-C. Suppose that x,', +++, x, are linearly independent 
elements of Xf, and let y' € X/ be such that y'(x) — 0 whenever 
Xy(x)-2...-x,(x) 20. Then y' is a linear combination of xy, =- -, 


XQ 
PROOF. For the case n — 1 we get the proof directly from (3.5-1). If 
x,’ z 0, and if y'(x) = 0 whenever x,'(x) = 0, we have. 
D y'(xo) , 
= Xi, 
x1'(xo) i 


where xg is any element for which x,'(xo) 4 0. We now proceed 
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inductively, assuming the theorem true for a set of n — 1 linearly inde- 
pendent elements of X/. It then follows, since x,’, ---, x,’ are linearly 
independent, that for each k(k = 1, ---, n) there exists an x, such that 
Xk (Xx) # 0 and x/(x,) = 0 if j # k. Because of homogeneity we may 
arrange to have x,'(x,) = 1. Now let 


yex-— > Xg (X) Xz. 
k=l] 


We then see that x,'(y) = 0 for each j; hence also y'(y) = 0, by our 
assumption. But then 
y(x) = > x,'(x)y'Ga); 
k-l 
this is equivalent to 


= 


y = y Ga)xy', 
kl 
and the theorem is proved. 


Theorem 3.5-D. Let X be a topological linear space. The closure of 
a linear variety in X is a linear variety. 


PROOF. Suppose first that M is a linear subspace. Now, the following 
general proposition is true: If fis a continuous function which maps one 
topological space into another and S is any set in the first space, 
HORS KS). This is easily proved, directly from the definition of 
continuity. Now consider f to be the function which maps X x X into 
X, the value of f at (x, y) being x + y. We know that fis continuous. 
Hence (M x M) c f(M x M). But, since M is a subspace, (M x M) 
C M. Thus/(M x M)c M. This shows that x + y € M if x © M and 
»y€M. A similar argument, using the continuity of ax, shows that 
axeM if x € M. Thus M is a subspace. A translation is a homeo- 
morphism; therefore the closure of any linear variety is a linear variety. 


Theorem 3.5-E. Let X be a topological linear space and M a hyper- 
plane containing 0. Then, either M is a closed set, or it is everywhere 
dense in X. Suppose M = (x:x'(x) = 0}, where x’ is a fixed element of 
X7. Then M is closed if and only if x' is continuous. 


PROOF. We have M c M c X, and M is a subspace. Since M is 
maximal, we have either M = M or M = X. This proves the first 
assertion. If x’ is continuous, M is closed, for it is the inverse image 
(by x’) of a single point in the scalar field. Suppose, on the other hand, 
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that M is closed but that x’ is not continuous. Then it is not continuous 
at 0, and there is some e > O such that every neighborhood U of 0 contains 
some point for which |x'(x)) > e. Now let L = (x:x(x) = «/2}. The 
set L is obtained from M by translation. In fact, if xy € Y — M, Lis the 
set of all elements of the form [e/2x'(xo)]xo + m, m € M, as we see by 
(3.5-1). Therefore L is closed. Hence there exists a neighborhood of 0 
which does not meet L. We can choose a balanced neighborhood U of 
this kind, by Theorem 3.3-E. Now U must contain a point x, such that 
|x (x)| 2 e Let a = [e/2x (xj). Then ex; € U, for U is balanced. 
But x'(«x41) = «/2, so that «x, € L, and we have a contradiction. There- 
fore x' is continuous. 

We remark, for later use, that, if a hyperplane is closed, all the 
translations of it are likewise closed and that, if it is not closed, each of 
these translations is everywhere dense in X. 


3.6 Convex Sets and Hyperplanes 


In this section we assume throughout that X is a real linear space; all 
scalars which occur are real. 

Our object in this section is to discuss certain geometrical relationships 
between convex sets and hyperplanes. Some of the theorems have 
important uses in connection with applications. 

If M = (x:x' (x) = aj is a hyperplane (x' 4 0, o fixed), each of the sets 
íx:x'(x) < aj, {xix (x) > aj, (x:x'(x) < aj, (x:x'(x) > a} 
is convex. Each of these sets is called a half space determined by M. If 
X is a topological linear space and x’ is continuous, the first two of these 

half spaces are open and the last two are closed. 

We say that a set S lies on one side of M if S lies entirely in one of the 
four half spaces determined by M. If S lies on one side of M and does 
not intersect M, we say that SS is strictly on one side of M. 


Theorem 3.6-A. In order that a convex set S lie strictly on one side 
of a hyperplane M, it is necessary and sufficient that the intersection 
SO M be empty. 


PROOF. The condition is necessary, by definition. Let M = (x:x'(x) 
= a}, suppose that x, and x; are in S and that x'(xj) < « < x(x). Now 
Ax, + (1 — àx lies in S if 0€ A&«], and x'(Ax, + (1 — A)x.) = 
Ax'(xj) + (1 — A)x' (x5) is a continuous function of A which has the value 
X'(x;) at A = 0 and the value x'(xj) at A= 1. It must then have the 
value a at some A for which 0 < A < 1. But then Ax, + (1 — 3x5 E S 
OM. Hence SA M = 9 implies that S lies strictly on one side of M. 
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Theorem 3.6-B. Let K be a convex, absorbing set which contains 0, 
and let p be its Minkowski functional (see $ 3.41). Let M be a hyperplane 
which does not intersect K. There exists x' € Xf such that M = (x:x'(x) 
= 1}, and for this x' we have 


(8.6-1) = p(— x) < x) < pix) 
if x e X. 


PROOF. Any M which does not contain 0 can be represented in the 
form M = {x:x'(x) = a} where « #0. This follows readily from 
Theorem 3.5-A. We can then, on multiplying x’ by a suitable constant if 
necessary, assume that « = 1. Since 0 € Kand x'(0) =0, we see (Theorem 
3.6-A) that K lies strictly on one side of M and in the half space 
{x:x"(x) < 1}. Thus x(x) < 1 ifxeK. Now consider any x € X, and 
suppose «€ 4, (notation as in $3.41) Then O «a, ao lxeK, 
x'(a-!x) < 1, and x'(x) < a. But then x'(x) < p(x), by the definition of 
P(x). We also have x'(— x) < p(— x), whence — p(— x) < — x'(— x) 
= x'(x) This completes the proof. 


Theorem 3.6-C. Let X be a topological linear space and M a hyper- 
plane. Suppose that S is a set having at least one interior point and lying 
on one side of M. Then M is closed; the interior of S lies strictly on one 
side of M, and the closure S also lies on one side of M. 


PROOF. Let M = {x:x'(x) = a}. We can suppose that S lies in the 
half space (x:x'(x) < a} (otherwise replace x’ by — x’ and « by — a). 
Now M must be closed, for otherwise the hyperplane (x:x'(x) = « + 1j 
would be everywhere dense and would, therefore, intersect S (since S has 
an interior point). Consequently x’ is continuous (Theorem 3.5-E). 
But then the set (x:x'(x) < o) is open, and it is the interior of the closed 
set (x:x'(x) € a}, for it is easy to see that x is not an interior point of 
the latter set if x'(x) = « (if « # 0 merely consider Ax for A sufficiently 
near 1; otherwise use a preliminary translation). The assertions about 
the interior and closure of S now follow at once. 


Theorem 3.6-D. Let K be a convex absorbing set which contains 0, 
and let p be its Minkowski functional. Let L be a linear variety which 
does not intersect K. Then there exists a hyperplane M with equation 
x'(x) = 1 such that M contains L and x'(x) < p(x) for every x. The set 
K lies in the half space (x:x'(x) < 1}. If X is a topological linear space 
and K has interior points, x’ is continuous and M is closed. In this case 
the closure of K lies in the half space (x:x'(x) < 1}, and the interior of K 
lies in the open half space (x:x'(x) < 1}. In particular, if K is open, K 
does not intersect the closed hyperplane M. 
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PROOF. Choose x9 € L and let Lọ = — xg + L. Observe that x9 is 
not in Lo, for, if it were, we should have L = Ly; then 0 € LA K, whereas 
LOK is empty. Let Xo be the set of all elements of the form 
X = aX; + y, y € Lọ- Xo is a subspace, and Lọ is a maximal subspace of 
Xo. For, suppose L; is a subspace such that Lo © Ly € Xp and Ly z Ly. 
Choose xy € L4 — Lg. Then x4 = «xg + yı, where y; € Ly and a, 4 0. 
Now, if x = ax) + y € Xy, we can write x = (a/a,)x, + z, where 

= — (efoj)y, + y. Since z € Lọ, we see that x eL,. Thus L, = Xp. 
This shows the maximality of Lọ in Xo. Now consider KM Xo. Itisa 
convex and absorbing set in X; it contains 0, and its Minkowski 
functional is the restriction of p to Xy. Since KA X, does not intersect 
L, we know by Theorem 3.6-B that there exists g € (Xo9)/ such that 
L = {x:xE Xp} g(x)- 1} and g(x) < p(x) if xeX,. By Theorem 
1.71-D there exists x'&€ X^ such that x'(x) = g(x) if xe Xy and 
x'(x) < p(x) if xeX. The hyperplane M = (x:x'(x) = 1} evidently 
contains L. Theorem 3.41-B shows that x'(x) <1 if xe K. If we 
assume that X is a topological linear space, the last assertions of the 
theorem follow from Theorem 3.6-C. 


Theorem 3.6-E. Let K be a nonempty open convex set in a topological 
linear space X, and let L be a linear variety which does not intersect K. 
Then, there exists a closed hyperplane M which contains L and is such that 
K lies strictly on one side of M. 


PROOF. The theorem is true if it is true for the case in which 0 € K, 
as we see by making suitable translations. But, if 0 € K, K is absorbing, 
and the theorem results at once from Theorem 3.6-D. 


PROBLEMS 


A general X referred to in these problems is a real topological linear space. 


d. If K, and K, are nonempty, nonintersecting convex sets and if K, is open, 
there exists a closed hyperplane M such that K, is in one of the two closed half 
spaces determined by M and Kz is in the other. If K is also open, M can be 
chosen so that K; and K> are strictly on opposite sides of M. Argument: 
K = K, + (— 1)K; is convex, nonempty, open, and does not contain 0. Hence 
there exists a closed hyperplane through 0 and not intersecting Kx A suitable 
parallel hyperplane can be chosen for M. 


2. If S C X, a support of S is a hyperplane M such that S lies on one side of 
M and SOM £ 0. If xye S M, we say that S is supported by M at x. 
A closed convex set with a nonvacuous interior is called a convex body. Show 
that a support of a convex body is closed and that the body is supported at every 
boundary point. (See problem 2, § 3.4.) 
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3. Let K be a convex body in X and not all of X. Consider the closed half 
spaces containing K, and determined by the supports of K (see problem 2). 
The intersection of all these half spaces is K. 


4. There exists a nonzero continuous linear functional x’ defined on X if and 
only if in X there is at least one convex set which is open and contains 0 but is 
not all of X. For the “if” part, use Theorem 3.6—E, taking L to be a point not 
in the convex set. M. M. Day (see Day, 1) has shown that there exists no 
nonzero continuous linear functional on L^(a, b) if 0 < p < 1. For the topology 
of L?(a, b) see § 3.3, problem 7. 


3.7 Seminorms 


The concept of a seminorm plays an important role in the study of 
topological linear spaces. Seminorms are analytical devices for dealing 
with convex sets of a special sort. Seminorms are useful in describing 
the topology of a linear space if it is of the special type known as a locally 
convex topological linear space (see $ 3.8). 


Definition. Let X be a linear space (real or complex), and let p be a 
function with real values defined on X such that 
(a) P(X, + x) S px) + p(x.) if x1, x; ex, 
(6) plex) = |elp(x) if x € X and « is any scalar. 


Then p is called a seminorm on X. 
If p has the further property that p(x) 7 0 if x #0, p is a norm (see 
§ 3.1). As with a norm, the properties of p imply the further properties 


8.7-1) p(0) = 0, 

(3.7-2) p(x) > 0 

and 

(3.7-3) [pGa) — p(%2)| < pon — x3. 


As we see by Theorem 3.41-A, if p is the Minkowski functional of a 
convex, balanced, and absorbing set K, then p is a seminorm. The 
following theorem shows that the converse is also true. 


Theorem 3.7-A. Let X be a linear space and p a seminorm on X. 
Let V be the set (x:p(x) < 1). Then V is convex, balanced, and absorbing, 
and p is the Minkowski functional of V. If we suppose in addition that X 
is a topological linear space and that p is continuous, the set V is open. 


PROOF. Suppose x,, x €V and O<a<l. Then p(xj) « 1, 
p(x) < 1, and i 


pK — ex, + ex] < (1 — px) + ap(x?) < 1, 


144 INTRODUCTION TO FUNCTIONAL ANALYSIS [83.7 


by the properties a and b of p. Thus V is convex. The fact that V is 
balanced and absorbing follows from the homogeneity property b of p. 
Let q be the Minkowski functional of V. By definition, this means that 
q(x) is the infimum of positive numbers « such that x e«aV. Buta > 0 
and x € «V are together equivalent to « > O and p(x) < a. Itis therefore 
clear that p(x) = q(x). ‘The final assertion of the theorem, about V being 
open, is true as a consequence of Theorem 2.12-A. 

"Before considering the next theorem we shall make some general 
observations about linear functionals on complex linear spaces. Suppose 
that X is a complex linear space. Then, we can also regard X as a real 
linear space simply by restricting our attention to real scalars. Let us 
denote by X, the real linear space obtained from X by adopting this 
point of view. Now consider a linear functional x' e Xf. If x eX let us 
denote the real and imaginary parts of x'(x) by x,'(x) and x;'(x), respect- 
ively, so that x'(x) = xj'(x) + ix;'(x). Since x'(ix) = ix'(x), we have 


x (ix) + ixj'(ix) = ix,'(x) — x? (x), 
whence x(x) = — x,'(ix), and so 
(3.74) x(x) = x,'(x) — ix (ix). 


It is readily verified that x,’ € (X,/, i.e., that x,' is a real-valued linear 
functional on the real linear space X,. Conversely, if we start with any 
element x,’ €(X,)f and define x’ by (3.7-4), it is easy to verify that 
X'(ax) = ax'(x) for all complex scalars and that x’ € Xf. 


Theorem 3.7-B. Le: X be a linear space, and let p be a seminorm 
defined on X. Let M be a linear manifold in X and f a linear functional 
defined on M such that | f(x)| < p(x) if x € M. Then, there exists a linear 
functional F defined on X such that |F(x)| < p(x), if x € X, and F(x) = f(x) 
if x e M. 


PROOF. Observe that the seminorm p is a sublinear functional (defined 
just preceding Theorem 1.71-D). Since p(— x) = p(x), it may be noted 
that, for a linear F, F(x) < p(x) for all x implies |F(x)| < p(x). For 
— F(x) = F(— x) < p(— x) = p(x), or — p(x) < F(x). The two in- 
equalities yield |F(x)| < p(x). 

For the case in which X is a real space, the present theorem is a direct 
application of Theorem 1.71-D. If X is a complex space, we proceed 
as follows: Denote X by X, when we consider it as a linear space with 
real scalars; likewise with M and M,. We write f(x) = fi(x) — ifi(ix), 
with f(x) the real part of f(x). Then f, isa real linear functional on M, 
[by the discussion accompanying (3.7-4)]. Now, |A] < |f] < pœ) 
if xe M. Hence, by what we already know for the real case, there exists 


$3.8| TOPOLOGICAL LINEAR SPACES 145 


a real linear functional F; on X, such that Fi(x) = f(x) if x € M, and 
FO] € p(x) ifxeX. We define F(x) = F(x) — iFi(ix) Then Fisa 
linear functional on the complex space X, and F(x) = f(x) iif xe M. For 
any given x let F(x) = rei? (r 2 0). Then F(e-iex) = e-i?F(x) =r. 
Since this is a real value, F(e-i?x) = F,(e-*x) Then |F(x)| = F(e-i9x) 
< p(e-i?*x) = p(x). This completes the proof. 


Theorem 3.7-C. Let X be a topological linear space, xg a point of X, 
and p a seminorm on X which is continuous. Then, there exists a continuous 
linear functional F defined on X, such that F(xo) = p(xo) and |F(x)| < p(x) 
if x € X. 


PROOF. Let M be the set of all elements «xo, and define f on M by 
flexo) = ep(xo) Then fis linear on M and | f(ax9)| = plexo). Hence, 
by Theorem 3.7-B, there exists a linear functional F defined on X such 
that F is an extension of f and |F(x)| < p(x). This inequality shows that- 
F is continuous at 0 (and hence continuous at all points) because p is 
continuous. Clearly F(x) = f(xo) = p(xo). 


Theorem 3.7-D. Let X be a topological linear space, and let V be a 
subset of X which is closed, balanced, convex, and of which 0 is an interior 
point. Let xg be a point on the boundary of V. Then, there exists a 
continuous linear functional F defined on X such that F(xo) = 1 and 
|F(x)| < lifxeV. 


PROOF. Let p be the Minkowski functional of V (see §3.41). The 
properties of V assure us that p is a seminorm (by Theorem 3.41-A), and 
by Theorem 3.41-C we see that V = {x:p(x) < 1}, that p is continuous, 
and that the interior of V is the set (x:p(x) « 1}. Consequently 
P(X) = 1, since xo is on the boundary of V. The conclusions now follow 
from Theorem 3.7-C. 


One of the important uses of this theorem is in the proof of Theorem 
4.7-C. 


3.8 Locally Convex Spaces 


Among topological linear spaces which are not normed linear spaces, 
there is a class of spaces for which theoretical developments along the 
lines drawn for normed linear spaces seem to be more satisfactory than 
is possible without restriction of attention to this class. This class of 
spaces is characterized by the existence of a base at 0 composed of convex 
sets. The spaces are said to be locally convex. The main reason for 
singling out locally convex spaces for special attention lies in the fact that 
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for such spaces we can prove certain important theorems about the 
existence of continuous linear functionals. In this section we discuss 
briefly a few of the main features of locally convex spaces. 


Definition. A topological linear space X is called locally convex if 
every neighborhood of 0 contains a convex neighborhood of 0. 

If X is locally convex and @ is the family of all balanced and convex 
neighborhoods of 0, this family is a base at 0 (see Theorem 3.4-H). It 
is easily verified that, if Ue Y, then «U E€% when a # 0; also, there 
exists Ve 4/ such that V + V € U (use Theorem 3.4-B). 

One way of constructing a locally convex topology is described in the 
following theorem. 


Theorem 3.8-A. Suppose that X is a linear space and that U is a 
nonempty family of nonempty subsets of X with the properties: 


1. Each member of & is balanced, convex, and absorbing. 

2. If U € &, there exists some a such that O < o <S !/; and aU e X. 

3. If U, and U, are in U, there exists U; € & such that U} € U, N Us. 
4. If U € t and x € U, there exists V € Y such that x + VC U. 


Then there is a unique topology for X such that X is a locally convex 
topological linear space with Y as a base at 0. 


PROOF. If we compare this theorem with Theorem 3.3-F, we see that 
it suffices to prove that, if U € Y, there exists V € Y such that V + V c U. 
With U given we select « as in (2), and let V = «U. Then V+ V = 
aU + «U = 2aU C U as a result of the fact that 2« < 1 and that U is 
convex and balanced. 

Next we show how seminorms may be used to define a locally convex 
topology. 


Theorem 3.8-B. Let P be a nonempty family of seminorms defined on 
the linear space X. For each p € P let V(p) be the set (x:p(x) < 1}. Let 
U be the family of all finite intersections 


rn V(py O rY(p)n--ornVp, re> 0, Pe EP. 
Then Y satisfies the conditions of Theorem 3.8-A. 


PROOF. The sets V(p) are balanced, convex, and absorbing (Theorem 
3.7-A). The members of 4 also have these properties. Verification of 
conditions 2 and 3 in Theorem 3.8-A is left to the reader. As for (4), if 
U = VP) AO -+ O r,V(p,) and x € U, it suffices to take V = e4V(pi)' 
0 oV V(p,), where ey = ry — p(x). 

Observe that rV(p) = (x:p(x) « r}. 
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Definition. The topology for X determined by taking the family 7 
of Theorem 3.8-B as a base at 0 is called the topology generated by the 
family P of seminorms. 


Observe that, if P contains just one element p and if p is a norm, 4 is 
the family of all spheres (x:p(x) « r}, and the topology for X generated 
by P is the topology of X as a normed linear space with norm p. 

If X is a locally convex space and P is the family of all continuous 
seminorms on X, the topology of X is exactly the topology generated by 
P. The fact that P is not empty follows from the results of $ 3.41 (see 
especially Theorem 3.41-C, part e). ; 

If pi, «++, p, are seminorms on X and if o4, --+-, @, are positive, let us 
define 


P(x) = max (expri), M e, p«(x))- 


Then p also is a seminorm. If p;, ++, p, are continuous, so is p. These 
observations are useful in connection with the formulation of the 
continuity of a linear operator by means of conditions involving semi- 
norms. 


Theorem 3.8-C. Let X and Y be locally convex topological linear 
spaces, and let Q be a family of seminorms which generates the topology of 
Y. Let T be a linear operator on X into Y. Then T is continuous on X 
if and only if to each q € Q there corresponds some cantinuous seminorm p 
on X such that q(Tx) < p(x) for each x € X. 


PROOF. We prove the “only if" assertton and leave the rest of the 
proof to the reader. Let T be continuous, and suppose q € Q. Then 
{y:q(v) < 1) is a neighborhood of 0 in Y. Hence there exists a set 
V =r Wp) A: -A r,V(p,) (in the notation of Theorem 3.8-B), deter- 
mined by continuous seminorms pj, :: -, p, on X and positive numbers 
7,55, Fm Such that q(Tx) < lif xeV. Then 


1 
p(x) = max — p(x) 
k Tk 


defines a continuous seminorm p. If x is arbitrary in X and « is chosen 
so that p(x) < a, it follows that x/a € V and hence q(Tx) <a. Since « 
can be as close to p(x) as we please, we infer that q(Tx) < p(x). 

The reader will note that the condition for continuity in the foregoing 
theorem specializes to the condition ||Tx| < M||x|| of Theorem 3.1-A in 
case the.space is a normed linear space. 

We come now to the theorems about the existence of continuous linear 
functionals in certain situations. 
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Theorem 3.8-D. Let X be a locally convex topological linear space. 
Let M be a linear manifold in X, and let f be a continuous linear functional 
on M. Then, there exists a continuous linear functional F on X which 
is an extension of f. 


PROOF. Since f is continuous and X is locally convex, there exists a 
balanced and convex neighborhood of 0, say V, such that | f(x)] < 1 if 
xeMfnVV. Let p be the Minkowski functional of V. Then p is a 
seminorm, it is continuous, and V = (x:p(x) « 1} (Theorems 3.41-A and 
3.41-C). For any x € M choose « so that « > p(x). Then p(x/a) < 1 
and so |f(x/o)| < 1, or |f(x)| « «. By letting « — p(x) we see that 
|f(x)| < p(x). Applying Theorem 3.7-B, we obtain a linear functional 
F on X which is an extension of f and such that |F(x)| < p(x) for every x. 
This inequality and Theorem 3.8-C show that F is continuous, so the 
proof is complete. 


Theorem 3.8-E. Let X be a locally convex topological linear space. 
Let X, be a closed subspace of X, and suppose xy € X — Xo. Then, there 
exists a continuous linear functional x' on X such that x'(x,) = 1 and 
x'(x) = 0 if x € Xo. 


PROOF. Consider the subspace M generated by x, and Xo, and re- 
present elements of M uniquely in the form m = axı + x, x€ Xo The 
set x, + Xo (i.e., the set of elements of M for which « = 1) is closed and 
does not contain 0. Hence there exists a balanced convex neighborhood 
of 0, which we denote by V, such that V does not intersect x, + Xo. Let 
p be the Minkowski functional of V; p is a continuous seminorm and 
V = {x:p(x) < 1}. We then have p(x, +x) 2 1 if xeX,. Let us 
define a functional m on M by setting m'(m) = o. We assert that 
|m'(m)| < p(m). If « — 0, this is clear, and if «#0, we have 
p(m) = plax; + x) = |e|p(x1 + 71x) > |e| = |m'(m)|, because «-!x e 
Xo- Since p is continuous it now follows that m’ is continuous. Observe 
that m'(m) = 0 if me X, and that m'(xj) = 1. Applying Theorem 
3.8-D we finish the proof. 


Theorem 3.8-F. Let X be a locally convex topological linear space 
which is a T,-space. Then, if xo # 0, there exists a continuous linear 
functional x' on X such that x'(xo) = 1. 


PROOF. We can take X, — (0) and apply Theorem 3.8-E; X, will be 
closed, since X is a T,-space. 
The next theorem gives a simple criterion for a space to be a T-space. 


Theorem 3.8-G. If X is a locally convex topological linear space with 
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topology generated by a family P of seminorms, then X is a T,-space if 
and only if to each x # 0 corresponds p € P such that p(x) # 0. 

The proof is left to the reader. 

The main reference to locally convex spaces in this book comes in 
connection with the study of “weak” topologies; one aspect of this 
subject is introduced in the following example, and other aspects are 
considered in $ 3.81. 


Example |. Let T be any nonempty set. Let X be a linear space 
composed of elements which are real-valued (or complex-valued) functions 
x defined on T. X need not comprise all functions defined on T. For 
example, X might consist of all bounded functions or of all functions 
meeting some prescribed condition, provided that x -- y and «x meet the 
condition whenever x and y do. As a family of seminorms take 


pAx) = [xo 


for each t € T. This family of seminorms generates a locally convex 
topology for X. With this topology X is a T;-space, by Theorem 3.8-G. 
We note that x, — x (convergence in the sense of this topology) means 
that x,(r) — x(t) (convergence in the usual sense for scalars) for each 
te T. 

There is an aspect of this topology for X which is interesting and 
significant, namely, the following: For a given t€ T consider x(t) as a 
function of x, with x varying over X. This function is continuous on X in 
the topology just defined. For, if xy € Y and « » 0 and U is the 
neighborhood of 0 defined by U = {x:p,(x) < ej, we see that 
|x(t) — xo(t)| < « means the same thing as x € xo + U. Suppose for a 
moment that we consider any topology for X which is such that x(r) is 
continuous as a function of x, no matter how f is chosen in T. Then, if 
e > 0, the set (x:|x()| < e} is open, for it is the inverse image of an 
open set of scalars. But 


{x:|x(t)| < e} = {x:p(x) < ¢}. 


Hence the given topology for X contains among its open sets the base at 
0 in the topology for X generated by the family of seminorms. This 
shows that the latter topology is the weakest topology for X with respect 
to which x(f) is continuous as a function of x for each t. It is called the 
weak topology of X as a space of functions. One specific example of T 
and X is that in which T is the set of positive integers and X is the space 
of all sequences x = (£1, £j, ---}. The weak topology of X arises from 
the demand that each £, be a continuous function of x. 
We conclude this section with an example of a different sort. 
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Example 2. Suppose c is either a positive real number or +. Let 
X be the linear space of all functions x of the complex variable t 
representable as a power series 


0 


which is convergent if |t| < c. The coefficients é, are to be complex. 
For each R such that 0 < R < c let 


pax) = > lé] Re. 
0 


It is readily evident that pp is a norm on X. The family of these norms, 
obtained by varying R, generates a locally convex topology for X and 
makes X a T;-space. Convergence in this topology is equivalent to 
uniform convergence on each compact subset of the set {t: |t| < c). This 
is easily verified if we recall that when 0 < b < c and M, = max |x(r)| 
for |t| = b, then 

M, 

a 


It may also be verified that a set S in this space X is bounded, in the 
sense defined in § 3.3, if and only if the family of functions forming the 
set S is uniformly bounded on each compact subset of the set {¢:|r] < c). 
It is a well-known theorem (due to Montel) of classical function theory 
that from every infinite sequence in such a family of functions there can 
be selected a subsequence which converges uniformly on each compact 
subset of the domain on which the family is defined. This leads (by 
means of the fact that X is metrizable and that when metrized it is 
complete) to the conclusion that the space under consideration has the 
property that all of its closed and bounded subsets are compact. Since 
the space is not finite dimensional, the situation is in strong contrast with 
the situation for normed linear spaces (see Theorem 3.12-F). For 
information about metrizability, see § 3.9, especially Theorem 3.9-B. 


ál < 


PROBLEMS 


l. Let P be the family of all seminorms on the linear space X, where X # (0). 
This family is nonempty, and the topology it generates is the strongest locally 
convex topology on X. Moreover, it is a Ti-topology. Suggestion: Given 
xo x 0, choose a Hamel basis for X of which xg is a member. For any x e X 
let p(x) be the absolute value of the coefficient of x, in the representation of x 
in terms of the Hamel basis. 
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2. If S is a set in the locally convex topological linear space X, S is bounded 
if and only if each continuous seminorm is bounded on S. Instead of all 
continuous seminorms it is sufficient to consider those in a family which generates 
the topology. 

3. For the next problem we require the following result: Let 4 and B be 
disjoint sets in the topological linear space X (not necessarily locally convex). 
Assume A compact and B closed. Then, there exists a neighborhood of 0, 
say V, such that A + V and B+ V are disjoint. Outline of argument: Assume 
(A + V) (B + V) £ 0, no matter how V is chosen (as a neighborhood of 0). 
If V is symmetric, this implies that A ^ (B + V + V) # 9, for we can choose 
aeA,beB,vieV,v;eVsothata + v = b + v2, whenceae AC (B * V+ V). 


n 
Show that, if Vi, ---, V, are symmetric neighborhoods of 0, N [A (B + 


i=] 


V; + V;)] x 9, and deduce the existence of xo € AM Q [4^ (B - Y V). 
V 


Hence, for any symmetric V, xo + V must intersect 4 O (B + V + V). From 
this deduce that xy € B, a contradiction. 

4. Let X be a real locally convex topological linear space. Let K,, K, be 
nonempty, nonintersecting convex sets in X, with K, closed and K, compact. 
Then, there exists a closed hyperplane M such that K, and Ķ; lie strictly on 
opposite sides of M. Argument: Let V be a convex neighborhood of 0. Then 
Kı + V and K, + V are open and convex. By problem 3 we may choose V 
so that (K; + V) ^(K; + V) = 09. Now apply the result of problem 1, § 3.6. 

5. If K is a closed convex set in the real locally convex topological linear 
space X, then K is the intersection of all the closed half spaces which contain it. 
Can we also assert this for open half spaces? 

6. Let K be a nonempty compact convex set in the real locally convex topo- 
logical linear T;-space. Consider the closed half spaces which contain K and 
which are determined by the supports of K (see problem 2, 83.6). The inter- 
section of these half spaces is K. It suffices to show that, if x9 is a point not in 
K, there exists a support M of K such that x9 and K are not in the same one of 
the two closed half spaces determined by M. Choose (xo) and K as the K, and 
K; of problem 4, and obtain a separating closed hyperplane, say with equation 
x'(x) = «. By considering the values of x’ on K, a suitable support of K may 
be found as a hyperplane x'(x) = f. 


3.81 Weak Topologies for Linear Spaces. Duality 


In this section we consider briefly the basic notions about a class of 
topologies, called weak topologies, for a linear space. These notions are 
developed further in connection with normed linear spaces, in Chapter 4. 

Suppose that X is any linear space (real or complex), and let F be a 
nonempty set in X/. In what follows immediately hereafter we use 
A, A,, A>, etc. to denote nonempty finite subsets of F. For any such A 
and any e > O let = 


U(A; e) = {x:|x'(x)| < e if x’ € A}. 
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It is no trouble to verify that 0 € U(A; ©), that U(A; e) is balanced, convex, 

and absorbing, that U(A, U 45; min [e,, ej] € U(A4,; e) O U(43; «;), and 

that «U(A4; e) = U(A; |u|e) if «œ #0. If x e U(A; e), let 8 = sup |x’(x)|, 
; x'e 


so that O< 8 « e Then x + U(4;e — 8) C U(A;e) It follows by 
Theorem 3.8-A that the family of all sets U(A; «) is a base at 0 for a 
uniquely defined locally convex topology on X. We denote this topology 
by 7(X, F). Ifpisthe Minkowski functional of U(A; e), itis a seminorm 
which is continuous on X in the topology just defined. It is easy to 
demonstrate that 


p(x) = : sup |x'(x)]. 


The following theorem is of basic importance to an understanding of 
the nature of the topology 7(X, F). 


Theorem 3.81-A. An element x' of Xf is continuous on X with the 
topology (X, F) if and only if x' is in the linear manifold generated by F. 


PROOF. The proof that x’ is continuous if x’ € F is easy, and we leave 
it to the reader. The “if” assertion follows at once. Now assume that 
y' € Xf and that y' is continuous in the 7 (X, F) topology. By Theorem 
3.8-C, with Y the space of scalars, we see that there exists some finite 
subset A of F and some « > 0 such that 


1G) < E sup 1x69] 


for every x in X. It follows that y'(x) = 0 whenever x'(x) = 0 for every 
x’ in A. If x,,--., x,’ is a maximal linearly independent subset of A, 
it follows by Theorem 3.5-C that y' is a linear combination of x,', -- 
x,'. This completes the proof. 

If A is a set consisting of a single element x’, then U(A; €) is the inverse 
image, under x’, of the set of scalars « for which ja| < e. It follows 
easily from this remark and Theorem 3.81-A that J (X, F) is the weakest 
topology for X which makes it a topological linear space and which makes 
all the elements of F continuous on X. This is the reason why Z (X, F) 
is called a weak topology for X. 

It follows from the foregoing remarks that, if M is the linear manifold 
generated by F, the topologies .Z(X, F) and .-Z(X, M) are the same. 
Also, if, M, and M, are linear manifolds in X7, with M; a proper subset 
of M, the topology .Z (X, M,) is strictly stronger than (X, M1). 

An explanation of the conditions under which F(X, F) makes X a 
T,-space depends upon the concept of a total set of linear functionals. 


"3 
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Definition. A set F< X/ is called total if to each x 4 0 in X there 
corresponds some x’ in F such that x'(x) # 0. Or, equivalently, F is 
total if x'(x) = 0 for each x’ € F implies x = 0. 


For example, if X = C[a, b] and F is the set of functionals of the form 
x'(x) = x(r), where a « r < b and r is rational, then F is total. 


Theorem 3.8I-B. The topology 7 (X, F) makes X a T,-space if uid 
only if F is total. 


This follows directly from Theorem 3.8-G. 

When F is total, we may identify X with a certain space of functions 
defined on F. We identify x with the function whose value at x’ in F is 
x'(x). The topology 7(X, F) is then the same as the weak topology 
described in Example 1, § 3.8, where T is taken to be F. 

Suppose now that M is a subspace of X7. If x is a fixed element of 
X and x' is a variable element of M, the expression x'(x) defines an 
element of M^, and the set G of such elements is a linear manifold and 
a total set in M/. Hence the weak topology 7(M, G) for M makes M 
a locally convex topological linear space and a T,-space. If M itself is 
‘total as a subset of Y^, we can identify X and G (i.e., the correspondence 
between x and the element of G which it defines establishes an isomorphism 
of X and G as linear spaces). In this case we shall write 7 (M, X) in 
place of 7(M, G). There is a kind of duality here: M is the class of all 
linear functionals on Y which are continuous in the topology 7 (X, M), 
and X is identified with the class G of all the linear functionals on M 
which are continuous in the topology 7 (M, X). 

It sometimes happens that we consider weak topologies for a linear 
space X which is already a locally convex topological linear space, say 
with a topology Jọ. Let M be the class of all those elements of X^ 
which are continuous on Y with respect to the topology Jọ. As we have 
already noted, the topology 7 (X, M) is weaker than 7, (though not 
necessarily strictly weaker) We observe, as a consequence of Theorem 
3.8-F, that, if X is a T;-space, then M will be total. 


Theorem 3.81-C. Let X, Zo, and M be as described in the foregoing 
paragraph (X need not be a T,-space). Then, a linear manifold in X is 
closed relative to the topology 4 o if and only if it is closed relative to the 
topology 7 (X, M). 


PROOF. Let L be the linear manifold in question. We prove that L is 
closed relative to 7(X, M) if it is closed relative to 7. The other half 
of the proof is evident by taking the complement of L and using the 
fact that .Z(X, M) is weaker than Jọ. Suppose xje X — L. By 
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Theorem 3.8-E there exists x’ e M such that x'(xg) = 1 and x'(x) = 0 if 
xeL. Suppose0 < e< 1. The set (x:[x' (x — xo)| < elis a neighbor- 
hood of x, in the topology 7(Y, M). This neighborhood lies in X — L, 
and therefore X — L is open relative to 72 (X, M). Then L is closed 
relative to 7(X, M). 


PROBLEMS 


I. Let X be any linear space and M any subspace of Xf. A nonempty 
subset S C X is bounded relative to the. topology (X, M) if and only if 
sup |x’(x)| < oo for each x’ e M. 
xes 


2. Let X be a locally convex topological linear 7;-space. Let M be the set 
of those x’ € Xf which are continuous on X. Let Vo be a balanced and convex 
neighborhood of 0 which is bounded relative to the topology 7 (X, M), and let 
Po be the Minkowski functional of Vy. Then po is a norm. It can be shown 
that the topology generated by po is the same as the given topology of X. See 
problem 8, § 4.4. . 

3. Let X be a complex linear space, and let X, be the associated real linear 
space (as in $8 3.7). If x’ € Xf and x(x) = x,'(x) — ix,'(ix), where xy € (X, 
[see (3.7-4)], we may look upon x’ as an element of (.X7),, and the correspondence 
x’ « x,’ establishes an isomorphism of (X^), and (X,. Let M be a complex 
linear manifold in X/, and let M, be the corresponding real linear manifold in 
(X). Show that the topology (X, M), as applied to X,, coincides with 
J (X,, Mj). 

4. Let X be a locally convex topological T,-space, and let S be a convex set 
in X. Let X' be the set of all the continuous linear functionals on X. Then, 
the closure of S with respect to the given topology of X is the same as the 
closure of S with respect to the weak topology 7(X, X^). Use Theorem 3.81-C 
and problem 5 in $3.8. 


3.9 Metric Linear Spaces 

Suppose that X is a linear space and that there is a metric d(x, x2) 
defined on X. If the metric has the property 
(3.9-1) d(x; + y, x2 + y) = A(x), x2) 2 


for every choice of x,, x; and y, we call it an invariant metric. If the 
metric is invariant, the choice y — — x; shows that 


(3.9-2) A(x, — X», 0) = d(xi, Xo). 


Conversely, if (3.9-2) holds for all choices of x1, x2, the metric is invariant, 
as we see at once. 
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Definition. We shall say that X is a metric linear space if it is a 
topological linear space with topology derived from an invariant metric 
d(x,, X2). 

A normed linear space is a metric linear space, for the metric d(x, x) 
= |x; — x}|| derived from a norm is certainly invariant. However, 
there are metric linear spaces in which the metric is not derived from a 
norm. In order to see the similarities and differences when comparing 
metric linear spaces with normed linear spaces, it is convenient to 
abbreviate d(x, 0) by the notation |x]. We see from the properties of 
the invariant metric that 


(3.9-3) Ix + y| < |x| + Iyl, 

(3.9-4) |- x| = |x], 

(3.9-5) |x| 20 if and only if x = 0. 

There is nothing to guarantee that |ax| = |«| |x|, however, and so |x| 


may not be a norm. An example will be given presently. Of course, 
d(x, 0) is a continuous function of x and «x is a continuous function of 
« and x; therefore |«x| is a continuous function of «and x. It follows that 


(3.9-6) la,x| > 0 if |o] — 0, 
(3.9-7) lax, — 0 if |x,| > 0, 
(3.9-8) lex,| — 0 — if]o,| — 0 and [x,| + 0. 


The following theorem shows how a metric linear space may be 
characterized by specifying properties of |x| rather than properties of a 
metric. 


Theorem 3.9-A. Let X be a linear space, and suppose |x| is a real- 
valued function on X with the six properties (3.9-3)-(3.9-8). Make the 
definition d(x,, x3) = |x; — x3]. Then d is an invariant metric on X, and, 
with this metric, X is a metric linear space. 


The proof is left to the reader. For continuity of scalar multiplication 
we observe that : 


[m x ax| X |(%p = o)x| s e» P x)| + (en = a)(Xn aa x)|. 


Some simple examples of nonnormed, but metric, linear spaces are 
based on the inequality 


A 4- B| |A| |B| 
3.9- JA ta- En -a 
O29) T+]4+B) r-lb 1-18 
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which is valid if A and B are arbitrary real or complex numbers. A proof 
of (3.9-9) follows readily from the observation that x(1 + x)-! increases 
as the real variable x increases, if x » — 1 (check by computing the 
derivative). 


Example |. The space (s) The class of all sequences x = (£j) 
becomes a metric linear space if we define 


(3.9-10) ix = > s B : 


o 
where {u,} is any fixed sequence of positive numbers such that > Un IS 
1 


convergent. We denote this space by (s). 
Convergence in (s) is merely componentwise convergence. That is, if 
x = (£P then |x? — xj — 0 as i co if and only if lim £P = £, 


for each n. Proof is left to the reader. It follows that (s) is a complete 
metric space. 


Example 2. The space S. Let [a, b) be a finite closed interval of the 
real axis. Consider the family of all real-valued functions defined on 
[a, b] which are measurable in the Lebesgue sense, but not necessarily 
bounded. By using almost-everywhere equality as an equivalence 
relation this family gives rise to a family of equivalence classes which we 
make into a linear space (see, e.g., the discussion of .Z» and L^ in Example 
7, § 1.2). If x is one of the equivalence classes, we define 


« [^ 1) 
(3.9—11) |x] = a T+ [x dt, 
where x(t) denotes a representative function for x. We then obtain a 
metric linear space, which we denote by S. We can also consider the 
case in which the functions are complex-valued. 

Convergence in S is interpretable in terms of convergence in measure. 
We recall the definition: x,(f) converges in measure to x(t) if for each 
€ > 0 the measure of the set {r:|x,(¢) — x(r)| 2 e} converges to zero as 
n— o. Let E,(e) be the set in question. By decomposing [a, b] into 
the union of E,(<) and its complement we see from (3.9-11) that 


x, — x| < m) + «(b — a), 


where m refers to Lebesgue measure. Also, since e(l + «)-! is an 
increasing function of « when « > — 1, we see that 


|) — x0 e 
Pondus bo T+ |x, — x0) We ET iz 
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From the foregoing considerations it is clear that |x, — x] — 0 as n — oo 
is equivalent to convergence in measure of x,(r) to x(t). From a well- 
known fact about convergence in measure it then follows that S is a 
complete metric space (see, e.g., Halmos, 2, Theorem E, page 93). 

A complete metric linear space has been called a space of type (F) by 
Banach (Banach, 1, Chapter III. The F is for Fréchet, who made 
important contributions in the early studies of linear spaces with a metric. 
Currently, however, the designation ‘‘a space of type (F)" is sometimes 
used with the additional assumption that the space is locally convex (see, 
e.g., Dieudonné, 2, page 499). 

We say that a topological linear space X is metrizable if its topology is 
metrizable, i.e., if there is a metric in X such that the metric topology 
is the same as the given topology of X. Now, in a metric space there is 
a countable base of neighborhoods at each point (e.g., the interiors of 
spheres of radii 1/n with centers at the point, n = 1, 2, ---). Moreover, 
a metric space is of course a T;-space. Hence, in order that a topological 
linear space be metrizable, it is necessary that it be a T,-space and that 
there exist a countable base at 0. These necessary conditions are also 
sufficient, not merely to guarantee that the space is metrizable, but that 
it be metrizable with an invariant metric. We state this formally: 


Theorem 3.9-B. Let X be a T;-topological linear space in which there 
exists a countable base at 0. Then X is metrizable with an invariant metric. 


We omit the rather lengthy proof of this theorem. See Kelley, 1, 
pages 185-186 and p. 210. 

In a metric linear space the concept of boundedness, as defined in 
§ 3.3 for a topological linear space, does not need to coincide with the 
concept of boundedness for a metric space, as defined in § 2.4. A set may 
be metrically bounded but not bounded in the sense of $3.3. This is 
easily shown to be possible in the space (s) of Example 1. In fact, the 
space as a whole is metrically bounded, but not bounded as a topological 
linear space. 


PROBLEMS 


1. A topological linear T,-space is metrizable if there exists a bounded 
neighborhood of 0. The converse is not true. A space is called /ocally bounded 
if there exists in it a bounded neighborhood of 0. 

2. Let X be a linear space, and suppose M is a subspace of X/. Then the 
topology (X, M) defined in $3.81 is metrizable if and only if M is total and 
possesses an at most countable Hamel basis. The topology is normable if and 
only if M is total and finite dimensional. 
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3. Consider L? = L(a, b), where (a, b) is any interval of the real axis and 
O<p<1. ForxeL»? let 


|x] = y |x(9)|? ds. 


Then L? becomes a complete locally bounded metric linear space according to 
the prescription of Theorem 3.9-A. For the inequality |x + y| < |x| + |y! 
see Hardy, Littlewood and Pólya 1, Theorem 199, page 147. The space is not 
locally convex; in fact, the only nonempty open convex set in L? is the whole 
space (see problem 4, § 3.6). 


4. Consider H?, where 0 < p < 1 (see Example 8, § 3.11). For f e Hr define 


2n 2n 
Vie sup, [Ufer de = f ifene do 

O<r<t JO `. 0 
Then H? may be regarded as a closed subspace of L°(0, 27). In contrast to 
the situation for L?, H? possesses many continuous nonzero linear functionals. 
In fact, for a fixed z with |z| « 1, f(z) is a continuous linear functional of f. 
Also, the Taylor coefficients in the power series expansion of f are such 
functionals. For discussion of H? when 0 < p < 1, see Walters, 1, 2. A.E. 
Livingston, 1, has shown that the space is not locally convex and hence certainly 
not normable. 


5. If x’ is a continuous linear functional defined on the space (5), there exists 
N 


a finite set o;, ---, «y such that x'(x) = bj c£, for each x e (s). 
n=1 
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4 


GENERAL THEOREMS 
ON 
LINEAR OPERATORS 


4.0 Introduction 


In this chapter the emphasis is principally on the study of continuous 
linear operators in normed linear spaces. Completeness of the spaces 
is assumed only where it seems to be essential for decisive results. Some 
important results, especially those concerning closed operators in § 4.2, 
are valid in complete metric linear spaces, where the metric need not be 
that defined by a norm. The middle portion of the chapter (§§ 4.5-4.71) 
is concerned with conjugate spaces and conjugate operators and presents 
the more intricate counterpart, for Banach spaces, of the purely algebraic 
study made in §§ 1.8-1.91 of the relations between an operator and its 
transpose. The later part of the chapter, beginning with § 4.8, is devoted 
to inner-product spaces, the special aim being to present some of the 
fundamental facts about continuous linear functionals and the adjoint of 
a bounded linear operator in Hilbert space. The theory of adjoint 
operators closely resembles the theory of conjugate operators but has 
certain special features because of the fact that the normed conjugate 
space of a complete inner-product space is congruent in a special way to 
the space itself. 

There are many far-reaching results in this chapter. The massive 
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Theorem 4.2-G is the fount from which spring many of the most important 
results in the theory of linear spaces. Theorems 4.2-H and 4.2-I, both 
very important, follow directly from 4.2-G. Theorem 4.2-I is the often 
used *'closed-graph theorem." From it we deduce the highly important 
and useful theorems which express, in one form or another, the principle 
of uniform boundedness. Our most general formulations of this principle 
are given in Theorems 4.4-B and 4.4-E. 

The normed-linear-space form of the Hahn-Banach theorem is given in 
4.3-A. This theorem is an indispensable tool in the proofs of many 
subsequent theorems. As an illustration of its more direct use in analysis 
we show, at the end of $4.3, how the Hahn-Banach theorem can be 
used to give an existence proof in connection with the Dirichlet problem. 

Weak topologies are of significant importance in the theory of normed 
linear spaces. We mention here especially Theorems 4.61-A, 4.61-C, 
and 4.62-A. 

A large block of material in this chapter deals with a bounded linear 
operator and its conjugate. There are many theorems, and it is hard to 
single out any selected few of them as being the most important. Those 
in $4.7 are more profound than those in $4.6. The pooling of all the 
results about an operator and its conjugate, using theorems from $$ 4.2, 
4.6, and 4.7, leads to the “state diagram" in $ 4.71, which is a complete 
tabulation of all the relations of a certain kind which can exist between 
an operator and its conjugate. 

In the last part of the chapter the central theorems are the representation 
theorem for continuous linear functionals on a Hilbert space (4.81-C), 
and the closely associated Theorem 4.82-A, on orthogonal complements 
(often called **the projection theorem"). 


4.1 Spaces of Linear Operators 


Linear operators were defined in $1.3. If X and Y are linear spaces 
(with the same scalar field), the set of all linear operators on X into Y is 
a linear space if we define addition of operators and multiplication of 
operators by scalars in the natural way, namely 


(A + B)x = Ax + Bx, (@A)x = af Ax). 


The operator which maps every x € X into the zero element of Y is the 
zero of the linear space of operators; without serious danger of confusion 
with other zeros we denote this zero operator by 0. 

If X and Y are topological linear spaces, those linear operators on X 
into Y which are continuous on X form a subspace of the space of all 
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linear operators on X into Y. We shall denote the linear space of all 
continuous linear operators on X into Y by [X, Y]. 

If Y — X, the space of all linear operators on X into Y is not merely 
a linear space; it is an algebra, according to the following definition of 
that term. 


Definition. A set X is called an algebra if it is a linear space in which 
to each ordered pair x, y corresponds an element of X denoted by xy and 
called the product “x times y," subject to the following axioms: 


1. (xy)z = x(yz). 

2. x(y + z) = xy + xz. 
3. (x + y)z = xz + yz. 
4. (ax)\(By) = (aB)(xy). 


Here it is understood that x, y, z are arbitrary elements of X and o, B are 
arbitrary scalars. The algebra is called real or complex according as 
the scalar field is real or complex. 


If the algebra X contains an element e such that ex — xe — x for every 
x, e is called the unit of the algebra; it is necessarily unique if it exists. 

An algebra is called commutative if xy — yx for every pair x, y. An 
algebra need not be commutative. 

If Xo is a subset of an algebra X and if x + y, ax and xy are in Xo 
whenever x, y are any elements of X, and « is any scalar, then X is called 
a subalgebra of X. Observe that X, is also a linear manifold, or subspace, 
in X. 

If A and B are linear operators on X into X, where X is any linear 
space, we define AB as the linear operator such that (AB)x = A(Bx) for 
each xe X. With this definition it is clear that the set of all linear 
operators on X into X is an algebra. Moreover, this algebra has a unit, 
namely, the operator J defined by Jx = x for every x. The continuous 
linear operators on X into X also form an algebra with this same unit 7. 
Instead of the notation [X, X] we shall use the simpler notation [X] for 
this algebra of all continuous linear operators on X into X. 

If X and Y are normed linear spaces, a linear operator 4 on X into Y 
is continuous on X (ie, A € [X, Y]) if sup |4x| < oo. For such an 


lix 1 
A we define 
(4.1-1) All = sup [4x]. 
lxi 1 
These matters were discussed in $ 3.1; see especially Theorem 3.1-A and 


formulas (3.1-1)-(3.1-3); the latter formulas give useful alternative 
formulas for ||Al|. s 
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Theorem 4.1-A. Jf X and Y are normed linear spaces, (X, Y] is a 
normed linear space with the norm defined by (4.1-1). If Y is complete 
so is [X, Y]. 


PROOF. We leave to the reader the simple verification that ||4|| is a 
norm on [X, Y]. We shall prove the assertion about completeness. Let 
{An} be a Cauchy sequence in [X, Y]. For given e > 0 let N be such that 
l4, — A,| « e if Nm and N«n. Then also, for each x, 
VA mX — AnXll < lA, — A, lxi < eixl. It is thus clear that {A,x} is a 
Cauchy sequence in Y. Since Y is complete, A,x has a limit which 
depends on x; we define Ax = lim A,x. It is readily seen that 4 is a 


linear operator on X into Y. Now (||A,]) is a bounded sequence (since 
every Cauchy sequence in a normed linear space is bounded), and we have 
A|| € M for all n, where M is some constant. Then ||A,x!| < M |ix|| for 
every x; it follows that ||Ax|| < M|x|. Therefore A is a member of 
[X, Y] by Theorem 3.1-A. If we now return to the inequality 
Amx — A,X|| < ellxi| and let n — oo, we see that |4,x — Ax|| < e|lx| fo: 
every x if N < m. This means that ||4,, — All < eif N < m. But thea 
Am — A in the topology defined on [X, Y] by the norm. Consequentiy 
[X, Y] is complete. 

Suppose that A, and A are in [X, Y] and that ||4, — A|| — 0. This is 
equivalent to the statement that |4,x — Axij — 0 uniformly for aii 
x € X such that ||x|| < 1. For this reason the topology for [ X, Y] defined 
by the norm (4.1-1) is sometimes called the uniform topology for [X, Y]. 

For the case Y = Y, [X, Y] = [X], we have the following theorem: 


Theorem 4.1-B. Suppose X is a normed linear space. Then 


(4.1-2) |ABl| < |All Bll 
for each pair A, B in [X]. Also 
(4.1-3) i] = 1. 


PROOF. For each x, ||(AB)x\| = ||A(Bx)|| < IAI Bxl] < |All IBI Ixl], 
and (4.1-2) is a consequence. The truth of (4.1-3) is immediate from the 
definition of the norm. : 

From (4.1-2) it follows that AB is a continuous function of the pair 
A, B. 

When X and Y are normed linear spaces, it is a common practice to 
call the elements of [X, Y] bounded linear operators. The use of the 
adjective “bounded” as an equivalent for “continuous” is explained by 
the remarks following formula (3.1—3). 

The next two theorems furnish very important information about the 
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existence and nature of inverse operators under certain conditions. 
Formula (4.1—4) is closely related to an old result in the theory of integral 
equations, generally known as the Neumann expansion (named after 
C. Neumann, cf. Hellinger and Toeplitz, 1, page 1347), though the 
method goes back as far as Liouville. 


Theorem 4.1-C. Let X be a Banach space, and suppose A € [X] and. 
|All < 1. Then the range of I — A is X, (I — Ay! exists and belongs to 
[X], and 


(4.14) U-Ay!-ItrAGTAbxee RAP 


the series converging in the uniform topology of the space [X]. Further- 
more, 


(4.1-5) Ig- Ay < 


1 — |A} 


PROOF. Since||4|| < 1, the series > |Air converges. But ||A*I] < || AJ)", 
0 


ty (4,12), and hence the series > A" converges in [X], owing to the 
9 
completeness of the latter space (see Theorem 4.1-A). If we let 


0 
B= 2: A^, we see that 
0 


AB = BA = Sam, 
0 


and hence 
Uu—4)0B-2B(I—A2)-L 


This implies that (J — A)! exists and is equal to B. The inequality 
(4.1—5) is now evident, and so the proof is complete. 


Theorem 4.I-D. Let X be a Banach space. Let R be the set of 
elements A € [X] such that (A) = X and A^! exists and is continuous. 
If Ac R, Be[X], and \|A — B|| < 1/|A71j|, then B € R, and 


lo 
T= jua - B 


1 — |A! [i4 — Bil 


(4.1-6) |B ll < 


(4.1-7) |B-! — Ai < 


Thus, in particular, R is an open set in [X] and A^! is a continuous function 
of A. ; 
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PROOF. We can write 
B=A-—(A—B)=A{l— AA — B)]. 
Since ||A-1(A — B)| < ||A-1|| ||A — Bl] < 1, it follows by Theorem 4.1-C 
that [/ — A-1(4 — B)]"! exists, is in [X], and is given by 
(4.1-8) U- A44 ~ B)! = > (AA — B)y. 
n=0 


It follows readily that B-! exists, belongs to [X], and is given by 
B= [I — A-A — B) A~. 


The inequalities (4.1-6) and (4.1-7) follow readily from the series (4.1-8), 
and we omit the details. It may be remarked that 


i47! I — 4718l 
—-1 — 4-1 pL — 
MESURES USC eae 


This will in general be a sharper inequality than (4.1-7), since 
lI — A3B|| = ||4-1(4 — B)j < l|471] ||A — Bl. Likewise (4.1-6) can be 
sharpened. 


PROBLEM 


Suppose that X, Y, and Z are normed linear spaces, that X is a subspace of 
Z dense in Z, and that Y is complete. Show that [X, Y] is congruent to 
[Z. Y] by mapping T e [Z, Y] into A € [X, Y], where A is the restriction of 
T to X. i 


4.11 Integral Equations of the Second Kind. The Neumann Ex- 
pansion 


We start out by referring back to Example 2 in § 1.5, where integral 
equations of Fredholm and Volterra type were defined. Such equations 
can be considered in various function spaces; at first we shall deal with 
the space of continuous functions. Let X be the Banach space C[a, b], 
and let K be the element of [X] defined by Kx — y, where 


b 
(4.11-1) POE i} k(s, Dx() dt, 


and the function K(s, f) (called the kernel) is subjected to certain restrictions. 
There are various sets of restrictions which are adequate for the purposes 
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of the developments which are to follow. The simplest restrictions are 
as follows: 


a. k(s,t) is continuous in both variables when ax s <b and 
axt«x b. 

b. If M is the maximum of |K(s, ?)| on the square [a, b] x [a, b], then 
M(b — a) « 1. 

These restrictions may be made less severe, but at the cost of some 
complication in statements and proofs. Our main purpose is to give an 
exposition of the formal aspects of part of the theory of integral equations 
of the second kind, and the conditions a, b will serve conveniently for 
the rigorous justification of the formal procedures. 

We are concerned with the equation 


b 
x9) = x9) - | kls, 0xt0 dr; 
a 
as an equation in the space X it can be written 


(4.11-2) y-x-— Kx. 


According to Theorem 4.1-C, this equation has a unique solution x for 
each given y if ||K|| < 1. (We do not assert that ||K|| < 1 is a necessary 
condition; only that it is sufficient.) The solution is 


(4.11-3) x= y + Ky + K?y FF Ky 6 ees 
Now, from (4.11-1) and the definition of M in condition b, we see that 
(4.11-4) IKI < M(b — a). 


Condition b then assures us that ||K|| < 1. 
We are going to show that each of the operators K?, K3,--- is of the 
same sort as K, with a suitable kernel. We shall define 


ki(s, t) = k(s, t) 
een) Los t) = |: ky(s, Wk,-1(u, t) du, ^ n» 1. 


By definition, z = K2y means z = K(Ky), or 
b b 
z(s) = f k(s, t) dt f k(t, u)y(u) du. 


We invert the order of integration, obtaining 


z(s) = | y(u) du f: k(s, t)k(t, u) dt, 


b 
z(s) — Í. k,(s, u)y(u) du. 
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Thus K2 is defined in terms of the kernel k, just as K is defined in terms 
of kı. It is easily proved by induction that z = K”y is expressed by 


b , 
(4.11-6) sies f k,(s, t)y() dt, 


so that k, is the kernel used to determine K”. For n > 1, k, is called 
the nth iterated kernel. 
The series (4.11-3) now takes the form 


(4.11-7) x(s) = y(s) + > Í : kals, t)y(t) dt. 
n=1 


The convergence of (4.11—3) as a series of elements in the Banach space 
C[a, b] means that (4.11-7) is uniformly convergent on [a,b]. Now 
consider the function h defined by l 


(4.11-8) h(s, 1) = >. kals, 0). 


It is easily proved by induction from (4.11—5) that 
|k,(s, )| < M"(b — ay}, n l1. 


Since we have assumed M(b — a) < 1, it follows that the series (4.11-8) 
converges uniformly; thus k is a continuous function of s and t. More- 
over, we can exchange the order of summation and integration in (4.11—7) 
and obtain 


(4.11-9) x(s) = y(s) + Í j h(s, t)y(t) dt. 


We shall define an operator H with h as kernel, so that z = Hy means 


b 
ze | As, Dy(t) dt. 
Then (4.11-9) becomes 
x = y + Hy. 


We thus arrive at the conclusion that, when conditions a and b are 
satisfied, there is an operator H determined by a kernel / in such a way that 


(4.11-10) Uu-Ky!-lI-cH. 


The kernel A is sometimes called the reciprocal kernel corresponding to 
k. It has also been called the resolvent kernel, but in modern operator 
theory the word resolvent is used in a slightly different way. 
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An operator K defined by a kernel k as in (4.11-1) is called a Fredholm- 
type operator. The name goes back to the Swede, Fredholm, who 
developed a comprehensive theory for integral equations of the second 
kind at the beginning of the twentieth century. 

The theory of Volterra integral equations may be developed inde- 
pendently, or it may be regarded as a special case, with important special 
features, of the theory of Fredholm integral equations. A Volterra-type 
operator K is defined by y — Kx, where 


yes i, k(s, DNO dt. 


We shall assume that the kernel k(s, f) is continuous in both variables in 
the triangular region defined by the inequalities a < t < s « b. If we 
define k to have the value 0 in the part of the square [a, b] x [a, b] where 
t > s, we can regard K as a Fredholm-type operator with this special 
feature of the kernel k. Since k(s, s) need not be 0, there may be dis- 
continuities of the kernel at points along the diagonal t = s of the square. 
'These discontinuities have no adverse effects on the earlier developments 
in this section, however. 

Tt may be verified by induction from (4.11—5) that, when k is a Volterra 
kernel, the iterated kernels k, are also Volterra kernels; that is, 
k,(s, t) = O ift > s. The iterative formula for k, becomes 


IN 
ta 


WC: ieys [| kis, site 8) du. kst d 
t 


From this it can readily be proved by induction that 


„s Om 
(4.11-12) |k,(s, t)| x M OEN 
where M is the maximum of |k(s, r)). Hence certainly 
lk, D| < M (n — 1)! 


This inequality shows that the series (4.11-8) converges uniformly. The 
function A(s, t) is also a Volterra kernel; it is continuous in the triangle 
a S t <S s < b, and h(s, t) = O if t > s. 

From (4.11-12) and the formula for K in terms of k, it follows that 


(b — ay 


(4.11-13) IK" < M» —4 


Consequently the series >» K converges in the uniform topology of the 


n=0 
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space [X]. A perusal of the proof of Theorem 4.1-C shows that the 
assertion made in connection with (4.1-4) remains valid under any 
conditions which insure the convergence of the series in (4.14). As a 
consequence, it follows that the equation y — x — Kx has a unique 
solution for each y, the solution being 


x= Y key. 


n=0 


Furthermore, this solution may be expressed in the form 
x(s) = y(s) + Í h(s, t)y(t) dt. 


The very important fact about Volterra integral equations of the second 
kind is, then, that such an equation is always uniquely solvable. The 
special nature of the Volterra-type operator K insures that the Neumann 
expansion is always convergent, regardless of the magnitude of the kernel 
k. This is not true in general in the case of a Fredholm-type operator. 


4.12 Z2 Kernels 


In this section we consider the space L(a, b) (hereafter in this section 
written simply as L2). Suppose k(s, f) belongs to the class Z?(E), where 
E is the square [a, b] x [a,b]. Then we call k an -Z? kernel. Such a 
kernel defines a bounded operator K on L? in the following way: If 
xer let y = Kx, where this means 


b 
y() =0 f k(s, t)x(t) dt. 


Since 
b 
Dio « f tks, olde [Ix at 

we see that i 

b b pb b 

f xor < [ | |k(s, pe ds at | |x(t)|2 dt. ` 
This shows that 

b rb à 
ixl = it < (PPA, DI? ds at) Ix, 


and hence that 


(4.12-1) IKI < ( f f " Is, DJ? ds ay. 
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As a member of .Z?(E), k(s, t) determines an element of the Hilbert 
space LE). We denote this element by k and its norm in LA(E) by |k||: 


(4.12-2) T ( T ii " Is, 2)? ds aJ. 


From (4.12-1) we see that ||K|| < |||. 
The equation y = x — Kx in L2 corresponds to a Fredholm integral 
equation 


b 
y(s) =? x(s) — f k(s, t)x(t) dt 


in #2. By Theorem 4.1-C we know that y = x — Kx has a unique 
solution x in L? for each choice of y in L?, provided that ||K|| < 1. This 
will certainly be the case if |k|| < 1. 

In the case of .Z? kernels we can define the iterated kernels k, and the 
reciprocal kernel A in a manner formally the same as we did in § 4.11 with 
continuous kernels. The details are somewhat different, however. The 
iterated kernels are defined essentially as before: k,(s, t) = k(s, t) and 


b 
heni J Titan 


where —? refers to the exception of a set of two-dimensional measure 
zero. It is not difficult to show by induction that we also have 


(4.12-3) k,(s, f) =° f E uc t die 


Also, by induction and the Schwarz inequality we find that k, is an 22 


kernel, with 
b fb b rb n 
f | tts. one as at < (ff |kG. nj ds dt), 


nll < nii. 


or 


It is a more delicate matter to estimate the numerical magnitude of 
k,{s, t). Let us write 


u(s) =° (f |k(s, |? 2 


v(t) =° (f |k(s, £)|2 as). 


Now, for each ¢ except on a set of measure 0, k(s, f) as a function of s 
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determines an element k, of L2. Likewise k,(s, f) determines an element 
kK. Formula (4.12-3) shows that 


ko = Kn-ik, = Kz, 
where z = K»-2k,. Thus 


b 
k,(s, t) =° f k(s, u)z(u) du, 


Is, | <9 (f Ik(s, u)|2 a) (f. |z(u)|2 du) 
[k,(S, £)| <° u(s) lizi. 


E 
, 


But 

lzi) = |Ke-2k,|| < IKI- kl] = IKIE), 
and so 
(4.124) le(s, D| «Kp m). © n > 2. 


This inequality shows that the series (4.11-8) converges and defines a 
function A(s, t) almost everywhere on E = [a, b] x [a, b], provided that 
[K| < 1. The inequality (4.12-4) also enables us to conclude that A is 
an £2 kernel, that the series (4.11—7) converges almost everywhere, and 
that we can reverse the order of summation and integration to obtain 


b 
x5) =0 y6) + [Ass 09) dr 


as the solution of the integral equation in Z7? (all this when ||K|| < 1). 
Observe that in this case the Banach space theory tells us merely that 
X — y + Ky + K2y t cc Ky b ns 


the series being convergent in Z2. The additional information that 
b b 
x6) = 16) + [46 DO dt e f e ars 
a a 
is convergent almost everywhere, with its terms dominated as in (4.12-4), 
is more than was obtained directly from Theorem 4.1-C. 
4.13 Differential Equations and Integral Equations 
In order to indicate some of the reasons why integral equations are of 
significant interest, we shall show how certain types of questions con- 


cerning differential equations can be recast as questions about integral 
equations. For simplicity we confine attention to second-order linear 
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ordinary differential equations. The discussion could be extended to 
cover ordinary equations of higher order. 

Consider the equation 
(4.13-1) y(s) + ay(s)y'(s) + ax(s)y(s) = x(s), 
where a, and a, are fixed continuous functions of s, defined when 
a<s<b. Let X = Cla, bj. The initial-value problem for (4.13-1) is 
the problem of finding y € X, with y' and y" also in X, so that (4.13-1) 
is satisfied and so that y(a) and y'(a) have preassigned values, say 
y(a) = a, y'(a) = «,. The function x is to be an arbitrarily assigned 
member of X. The fact that this initial-value problem always has a 
solution (and a unique one), no matter how ao, œj, and x are chosen, is 
a consequence of standard existence theorems in the theory of differential 
equations. But we can also demonstrate the fact by using what we have 
learned in $ 4.11 about Volterra integral equations. 

We write y'(s) — z(s), assuming for the moment that y is a solution of 
the initial value problem. Then 


f z(t) dt = y'(u) — ei, 


(4.13-2) f "du Í " (t) dt = ys) — ag — als — a). 


The iterated integral in this last formula can be expressed in the form 


f a i nes [i (s — nz) dt. 


On replacing y, y’, and y" in (4.13-1) by their expression in terms of z, 
we obtain 


13-3) 29) + aX. [2041 


+ a(s) œo + «(s — a) + f (s — f)z (t) at} = x(s). 


This equation is satisfied by z if y is a solution of the initial-value problem. 
Conversely, if z satisfies (4.13-3) and y is defined by (4.13-2), y is a 
solution of the initial-value problem. 

If we define 


k(s, ù = — a(s) — a(s) (s — D. 
w(s) = x(s) — «oax(s) — ex(ai(5) + ax(sXs — a)}, 
the equation (4.13-3) can be written in the form 


ror f k(s, t)2(t) dt = w(s). 


$4.13] GENERAL THEOREMS ON LINEAR OPERATORS 173 


This is a Volterra integral equation of the second kind. As we know from 
$4.11, it has a unique solution z € X for each we X. Therefore, the 
initial value problem for (4.13-1) always has a unique solution. 

There is another important class of problems related to the differential 
equation (4.13-1), namely the two-point problems. For a two-point 
problem we ask for a solution of the differential equation which satisfies 
a certain specified condition at s = a and another condition at s = b. 
A common form of condition is one in which we specify the value at an 
end point of some predetermined linear combination of y and y'. We 
shall illustrate by discussing the problem with the conditions y(a) = a, 
y(b) = B. We refer back to Example 3 of § 1.3 for certain things which 
we need. There it was shown (we change the notation slightly) that if 
x € C[a, b] and if 


(b — s)(t — a) whena <t<s 

c(s, t) = ee 
(s — aXb — 1) whens <t <b 
b—a : 


then the function 


b 
zem f e(s, tx) dt 
satisfies the conditions 
z'(s) = x(s), z(a) = z(b) = 0. 


Consequently the function 


(4.13-4) — y()- x — + pp - f c(s, x(t) dt 


satisfies the conditions 
yG)-xs a= y0-R. 
In (4.13-4) let us replace x(r) by 
x(t) — ai(0y'(0) — ax). 


In this way we see that y will be a solution of our two-point problem if 
and only if it has a continuous derivative and satisfies the equation 


S—a 


b—a 


E f «s, D(x() — ay) — aD} dr. 


(4.13-5) p(s) = TEE 4 B 
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The discussion of this equation is much simplified if we assume that 
a,(t) = 0. For this special case let us write 


k(s, t) =c(s, )axX(0, 


f c(s, t)x(t) dt. 


w(s) Zr - = 
Then (4.13-5) becomes 
b 
y6) = [ks DO) dr = wo). 


This is a Fredholm integral equation of the second kind. It will certainly 
have a unique solution y € C[a, b] if ||K]| < 1, where K is the Fredholm- 
type operator with kernel k. (The condition ||Kj| « 1 is sufficient; it may 
not be necessary.) We know from § 4.11 that ||K|| < M(b — a), where 
M is the maximum value of |k(s, ?)|. Now, the maximum value of 
(b — a) |c(s, t)| is readily found to be (b—a)?/4. Let A be the maximum 
value of |a,(t)|. Then certainly ||K|| < 1 if (b — a)24 < 4. We sum- 
marize the conclusions: 
The two-point problem for the equation 


y"(s) + axs)y(s) = x(s) 


with the end conditions v(a) = «. y(b) = B. is always uniquely solvable, 
with arbitrarily assigned «, B, x, provided that 


(b — a)? max |a;(s)| < 4. 


(For what may happen if this inequality is not satisfied, see problem 
14 in $ 5.5.) 

We return to the case when a,(t) #0. One way to handle this is to 
make a change of variable. If a;'(s) is continuous, we can define 


-p| aca 
gs) =e 7" 
and set y = uq. Then, with u as the new unknown, we have the equation 
u"(s) + (aXs) — 3a,'G) — 3aXS)PyuG) = Pol 


'The new end conditions are 


u(a) — = a, u(b) = 


B 
Ha) q(b) 
Since the v'(s) term does not appear in the differential equation, the 
previous method may be used to recast the problem as an integral equation 
problem. 
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If a, cannot be eliminated, so that the y' term is actually present in 
(4.13-5), we have what is called an integro-differential equation. It is a 
more complicated matter to discuss the possibility of solution of such an 
equation, and we shall leave the matter at this point. 

In some later sections (86.11 and $6.41) we shall discuss another 
phase of the relation between differential and integral equations, with 
applications to eigenvalue problems of differential equations of Sturm- 
Liouville type. 


4.2 Closed Linear Operators 


For the purposes of applications to analysis it is essential to consider 
some linear operators which are not continuous. However, many of the 
most important discontinuous linear operators have a property which in 
some respects compensates for the absence of the property of continuity. 
This property is most naturally described in terms of the concept of the 
graph of a function. 


Definition. Let X and Y be topological spaces. Let f be a function 
with domain Z and range # such that Z C X and Z c Y. The set 
{(x, f(x)):x e Z) in the product space X x Y is called the graph of f. 
The function is called c/osed in case the graph is a closed set in X x Y 
(with the topology of the product space as defined in § 2.5). 


Observe that the graph of f is the set of all ordered pairs (x, f(x)), 
where x € 2. 

In case X and Y are metric spaces, the topology of X x Y can also be 
defined by a metric. From Theorem 2.4-A we obtain the following 
theorem: 


Theorem 4.2-A. If X and Y are metric spaces a function f with domain 
Z2 c X and range Zc Y is closed if and only if the situation x, € , 
X, — X, f(x,) > y implies that x € 2 and f(x) = y. 

For many purposes the criterion for a closed function which we find 
it convenient to use is that given in Theorem 4.2-A. 


Example |. A discontinuous but closed operator: Let X = C[0, 1] and 
let X = Y. Let Z be the set of x € X such that the derivative x'(r) is 
defined and continuous on [0, 1]; let T be the operator with domain 2 
defined by Tx = x’. It is evident that T is linear. If x,(r) = t”, then 
lx = 1, x, (f) = nt, and so ||Tx,] = lx, = n (n = 1,2, --). Thus 
T is not continuous, because sup l[Tx|| = œ. But T is closed. In fact, 

lxi 


suppose x, € Z, x, — x, Tx, — y. Then x,(f) converges uniformly to 
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y(t), and y is continuous. Jt follows by a standard convergence theorem 
that x(r) is differentiable, with derivative equal to y(t). Therefore x € 2, 
Tx = y, and T is closed. 

One of the important fields of application of:functional analysis is in 
the theory of differential equations. Operators defined by means of 
ordinary or partial differentiation are frequently discontinuous, but in 
the applications it is often possible to arrange matters so that the differential 
operators to be dealt with are closed. 


Example 2. Let X = L2(0, 1). Let T be an operator with domain and 
range in X, defined as follows: Z(T) is the class of those x € X for which 
a representative function in .Z7(0, 1) can be found such that x(s) is 
absolutely continuous on (0, 1], x(0) = x(1), and x'(s) is in .ZX0, 1). 
This means that x(s) is of the form 


xs) =at lk u(t) dt, 
where u(t) € £2(0, 1), « is a scalar, and 
i 1 
[uma =o. 
0 


We then define Tx — x'. 
We shall demonstrate that T is closed. Assume that x, € Z, x, y e X, 
Xna > X, Tx, — y. We can write 


(4.2-1) x9) = x9 + ENOI 


Now 
f x, (t) dt — fso ad < [vo — y(t)| dt 
< Í [xn (D — yO| dt < (f, Ix (À — x2 ay(f. T au) 


Therefore f ] x, (t) dt converges to f y(t) dt; the convergence on [0, 1] is 
0 


1 1 
uniform with respect to s. In particular, ip y(t) dt = 0, since f x, (t) dt 
— 0. Next, ; 


XAO) — x40) = x6) — Eal) — |" Be) — xw (DN dt 


2 bi 
ds} . 


bx) — xm(0)] = (f. O — x.P aj 
< (f. Ix.) — x4)? ds): + rf | IN [x, (t) — Xm'(t)] dt 
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It then follows that {x,(0)} is a Cauchy sequence, with some limit o. 
Returning to (4.2-1), we see that x,(s) converges uniformly to the limit 
z(s), where 


zy f y(t) dt. 


Hence ze Z(T). Also, z'(s) «9 y(s). The uniform convergence of 
x«(s) to z(s) implies that 


[iso - 2091 s +0. 


That is, x, — z. Since x,— x, we must have x = z. But then z'(s) 
= y(s) means that Tx = y. Hence T is closed. 

We now present a group of four very elementary theorems which it 
is useful to have on record for later use. 


Theorem 4.2-B. Let X be a topological space, and let Y be a 
Hausdorff space. Suppose f is a continuous function, with range in Y, 
whose domain is a closed set in X. Then f is closed. 


PROOF. Let # be the range of f. If we suppose that fis not closed, 
the complement in X x Y of the graph is not open, so there must be a 
point (Xp, vo) in this complement such that every neighborhood of (xo, yo) 
contains a point of the graph. This implies that every neighborhood of 
xo (in X) contains a point of Z and thus that xy € Z. But then xg € 2, 
since Z is closed. Then y x f(xo), since otherwise (xo, yo) would be in 
the graph. Since Y is a Hausdorff space, we can find disjoint neighbor- 
hoods V, and V, of f(xy) and yọ respectively. From the continuity of f 
it follows that there is some neighborhood U of x, such that f(x) € V, if 
xEBNU. Now Ux V, is a neighborhood of (xy, yo) and must 
contain a point (xj, f(x,)) of the graph. Then x; €2^N U, and so 
f(x) € V,. But f(x) € V2, and so we reach a contradiction. 


Theorem 4.2-C. If f is closed and f~t exists, f~} is also closed. 


PROOF. The graph of f-! is the set ((/(x), x):x eZ) in Y x X. The 
result follows readily from this. 


Theorem 4.2-D. Let X and Y be normed linear spaces, with Y 
complete. Let A be a linear operator with domain £ c X and range 
Z= Y. Suppose that A is both closed and continuous. Then 2 is closed. 


PROOF. Supposex c Z. Then there exists a sequence (x,) from Z with 
X,— x. The sequence {Ax,} is a Cauchy sequence, for ||Ax, — Ax, 
€ Clix, — x,ll, where C is the norm of A as an operator on the space 2. 


178 INTRODUCTION TO FUNCTIONAL ANALYSIS [$4.2 


Hence {Ax,} has some limit ye Y. But then x € Z and Ax = y, since 
A is closed. 


Theorem 4.2-E. Let X and Y be normed linear spaces, with X complete. 
Let A be a closed linear operator with domain 2 € X and range AC Y. 
Suppose that A~! exists and is continuous. Then & is closed. 


PROOF. A`! is closed (Theorem 4.2-C), and Z is its domain. Hence 
4 is closed, by Theorem 4.2-D. 

There are certain conditions under which it may be concluded that a 
closed linear operator is continuous. One of the most important theorems 
of this type is that, if X and Y are complete metric linear spaces (and 
hence in particular if X and Y are Banach spaces), a linear operator whose 
domain is all of X and whose range is in Y is continuous if it is closed. 
This theorem is a consequence of the series of theorems which we shall 
now consider. 


Theorem 4.2-F. Let X and Y be topological linear spaces. Let T be 
a linear operator on X into Y, and suppose that the range of T is a set of 
the second category in Y. Then, to each neighborhood U of 0 in X 


there corresponds some neighborhood V of 0 in Y such that V € T(U). 


PROOF. For the convenience of readers who are primarily interested in 
normed linear spaces, we first give the proof for the case in which X is a 
normed linear space. Afterwards we shall indicate how to adapt the 
method of proof for the general case. 

If U is a neighborhood of 0 in the normed linear space X, there is an 
€ > 0 such that the open sphere ||x|| < 2e lies in U. Let W be the open 
sphere ||x|| < e. Then nW is the open sphere ||x|| < ne, and the union of 
the sets T(nW) for n = 1, 2, --- is the range of T. Consequently, since 
this range is of the second category in Y, there is some positive integer 
n such that the interior of T(nW) is not empty. But T(nW) — nT(W) 
= nT(W), and, since nT(W) and T(W) are homeomorphic sets, the latter 
also has a nonempty interior. Therefore there exists some point yọ € T(W) 
which is an interior point of T(W). It follows that 0 is an interior point 
of — yo + T(W). Now let V be a neighborhood of 0 in Y such that 
V € — yo + T(W).' Since y; € T(W), we can write yg = Txo, where 
xo € W. Elements of — yo + T(W) have the form — yo + T(w) = 
T(w — xo), we W. But w — x9 € U, because of the way in which W 
and U are related. Thus — yọ + T(W) c T(U). The closure of 
— yo + T(W) is — yo + T(W). Therefore — yọ + T(W) = T(U), and 
so also V c T(U). This finishes the proof in this case. 
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For the case in which X is an arbitrary topological linear space the 
only difference in the proof concerns the way in which W is chosen. We 
choose for W a balanced neighborhood of 0 such that W + Wc U (see 
Theorem 3.3-E). The fact that W is balanced and absorbing assures that 
X is the union of the sets nW, n = 1,2, ---.. Since — xo E€ W if xy e W, 
it follows in the proof that w — xy € W + W c U. All the rest of the 
argument is unchanged. 

In the next several theorems we deal with metric linear spaces, as 
defined in $3.9. We shall denote the distance from 0 to x by ||x||, rather 
than by |x|, as was done in $3.9. But the reader must remember that 
we do not have the property llex|| = [e| ||x|| at our disposal, since !|x|| 
need not be a norm. We do have ||- x|| = ||x|| and the continuity 
properties (3.9—6)-(3.9-8). Because we are dealing with metric linear 
spaces it is necessary, in a few places, to proceed in a manner more round- 
about and cumbersome than if we were dealing with normed linear spaces. 


Theorem 42-G. Let X and Y be metric linear spaces, and let X be 
complete. Let T be a closed linear operator with domain & in X and range 
# a set of the second category in Y. For each « > Q let B, be the closed 
sphere ||x\| < « in X and let C, be the closed sphere ||y|| < «in Y. We 
draw the following conclusions : 


1. To each « > 0 corresponds some B > 0 such that C4 € T(2 A B,). 

2. The range & is all of Y. 

3. If S is a relatively open subset of £, then T(S) is an open set in Y. 

4. If T— exists, it is continuous. 

5. In particular, if X and Y are normed linear spaces, we can conclude 
from conclusion 1 that there exists some m > 0 such that each y € Y is of 
the form y = Tx, where x € 2 and |x| < milyl. 


PROOF. If « > 0 is given, let U be the open sphere ||x|| < «/2 in X. 
Then UC B,;. By Theorem 4.2-F there exists an open sphere V in Y, 
defined by l|yl| < 28 for some 8 > 0, such that V € T(Z A U) (we take 
2 for the X in Theorem 4.2-F). Thus certainly VC T(2 A B,;). We 
shall show that V c T(Z A B,) if «/2 < y. Choose a sequence {e,} with 


€, > 0 and > e, < y — a/2. Let U, be the open sphere ||x]| < e, in X. 
1 


We know by Theorem 4.2—F that there exists a positive number 8, such 
that V, c T(Z A U,) if V, is the open sphere ||y|| < 6, in Y. We can 
evidently impose on the sequence (8,) the further requirement that 
ô > 0. Now suppose ye V. There exists a point of T(2 A Buz), 
which we can write as yọ = Tx, with xo € YO B,j?, such that ||y — yoll 
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« &, Then y — yo € V, and hence there exists a point y; = Tx, with 
X1€ 2 A U, such that |y — yg — yıll < 8). Proceeding in this way, by 
induction we define sequences ew and {y,} such that yp, = Tx 
X,€2(0U, and ly — ye — Yu — cc — Vall < 9$ n 1, 2, 


Since 3,— 0 we see that y = Sy, Now |x,| < e, if n 2 1, and 
D 


oo oo oo 


> lx, < 2 e, < y — a[2. Since X is complete, the series ` x, is 


0 1 1 
oo 


convergent, and there is a point x of X defined by x — > X, Moreover, 
f 0 


lx] « llxoll + > e, < y, Since xy E B,j5. Thus x € B,. The fact that T 
1 


is closed enables us to infer that x € Z and Tx — y (see Theorem 4.2-A). 
We have now shown that V c T(2 N B,). If we take y = o, the fact 
that C, € V now shows that C, € T(2 A B,). This proves (1). 

To prove (2) observe that, for any y € Y, (1/n)y — 0 as n — co, and 
hence |(1/n)yl| < B if n is large enough. Then (1/n)y € Cg, (1/n)y = Tx, 
where x € 2 B,, and y = T(nx), whence y e Z. Thus (2) is proved. 

To prove (3) we write S = 2N W, where W is an open set in 
X. Suppose yo € T(S), so that yo = Txo, xo E€ S. The set — x9 + W 
is a neighborhood of 0, and so contains B, for some « > 0. 
Then n9 B,c Zn(-xy4- W)- —x; * 20 W, and, by (1), 
C; € TIAN B) € T(—- x; + Z0 W) = — yo + T(S). It follows that 
Yo + CQ € T(S). Since yọ + Cg contains a neighborhood of yo, T(S) 
is open. Thus (3) is proved. 

The proof of (4) follows at once from (3) by Theorem 2.12-A, because 
(T~1)-1 = T. For proof of (5), which is concerned with the particular 
case in which X and Y are normed linear spaces, observe that, if ye Y 
and y z 0, then ||By/ly|| || = 8. Hence, by (1), there exists ue 2 with 
lul € « and Tu = By/lyl. Let x = (l»l/Bu. Then Tx — y and 
\|x|| < ej|y|l/B. Thus we can take m = a/f. 

Part 3 of the conclusion of Theorem 4.2-G is sometimes referred to as 
“the interior-mapping principle." 

Several important theorems follow readily from Theorem 4.2-G. We 
cite two such theorems, which will be used repeatedly in later parts of 
this book. 


Theorem 42-H. Let X and Y be complete metric linear spaces. Let 
T be a linear operator whose domain is X and whose range is all of Y. 
Suppose that T is continuous and that T-! exists. Then T^! is continuous. 
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PROOF. Tis closed, by Theorem 4.2-B. The range of T is of the second 
category in Y, since Y is complete. The conclusion now follows from 
Theorem 4.2-G. 


Theorem 42-1. Let X and Y be complete metric linear spaces. Let 
T be a closed linear operator whose domain is all of X and whose range is in 
Y. Then T is continuous. 


PROOF. Form the product space X x Y. It becomes a complete 
metric linear space if we define 


li y)|| = lxi + Iv, = (05 »)eX x Y. 


Since T is closed, its graph is a closed linear manifold in X x Y and can 
therefore be regarded as a complete metric linear space by itself. We 
define a linear operator A, with the graph of T as its domain and with X 
as its range, as follows: 


A(x, Tx) = x. 


Since |x|, < '|(x, Tx)||, A is continuous at (0, 0) and hence at every point 
of its domain. Evidently A~! exists and is defined by A-1x = (x, Tx). 
Then 4-! is continuous, by Theorem 4.2-H. It follows that T is 
continuous. 

Theorem 4.2-I has many applications and is used in many arguments. 
It is commonly referred to as the ‘‘closed-graph theorem.” 

We now consider some concrete applications of the last two theorems. 


Example 3. Let Y be the Banach space Cla, b], and let X be a linear 
space consisting of those functions in C[a, 6] which have continuous first 
and second derivatives on [a,b] and satisfy some definitely specified 
linear end conditions (e.g., x(a) = 0 and x'(a) = 0, or x(a) = x(b) = 0). 
Let T be the linear differential operator with domain X and range in Y 
defined by 7x — y, where 


(4.2-2) ac(s)x G) + ay(s)x'(s) + a2(s)x(s) = y(s). 


The fixed coefficients ao, aà,, a; are assumed to be in Y. We can make X 
into a Banach space by defining ||x|| to be the greatest of the maximum 
values on [a, b] of |x(s)|, |x’(s)|, |x'(s)], respectively. The operator T is 
continuous, for if 


M = |laol| + llall + Ileal), 
where ||a;|| is the norm of a, as an element of Y, we see that ||y|| = ||Txl| 


< M x. 
Now let us suppose that the differential equation (4.2-2) has a unique 
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solution x € X (i.e., satisfying the specified end conditions) for each 
choice of y € Y. That is, we assume Z(T) = Y and that T-! exists. It 
then follows by Theorem 4.2-H that T-! is continuous. The continuous 
dependence of x on y offers a certain assurance that “ perturbation- 
theory" methods for approximating the solution of the differential 
equation are satisfactory. That is, a small perturbation of the function 
y will result in a small perturbation of the solution x and of its first and 
second derivatives. The striking thing about this result is that it is 
obtained without any detailed knowledge of the behavior of the co- 
efficients ag, 44, a; or of the nature of the end conditions. There is, of 
course, the strong assumption that the problem always has a unique 
solution. 


The principle involved in the foregoing example can be applied to 
partial differential equations also. 


Example 4. Suppose | < p < œ, and suppose a sequence of scalars 
€, &2, &3, -- - Is given, with the assumption that the series 


oo 


> oye, 


is convergent whenever x = {&,} is an element of the space /^. We shall 
prove that the sequence (o) belongs to ir’, where p' = p/(p — 1). 

For each x and i let 
(4.2-3) m= >be i252. 


k= 


The sequence (5,) is bounded, since it is convergent. Hence equations 
(4.2-3) can be regarded as defining a linear mapping T of /? into /~, where 
y = {n;} and y = Tx. This operator T is closed, as we shall see. For, 
suppose x, — x and Tx, — z, where x, and x are in P andze/~, Let 


z= (b) and x, = {€”}. Then Tx, — z means that > e, £t? converges 


k=1 
uniformly to £; as n — œ. Now, by Hólder's inequality, 


< (> up - av) (> M 


k=1 


i l/p' 
< lix, — xi (> ir) ; 
k=1 


i 


» a8 — el 


k=1 k=i 
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Hence, since x, — x, the uniqueness of limits shows that 


i 


Li = > r2» 


k=1 


In other words, Tx = z. Thus T is closed. But then it is continuous, 
by the closed-graph theorem. It then follows that for any x and all i 


we have 
oo 1/p 
< irri (2 i 
k=1 


Now let us make a special choice of x as follows: 


P ul 


k=1 


(4.2-4) 


ér = Gy, | cx, |P’-2 if 1 < k < i and e * 0, 


& =0 otherwise. 


Then 
ee = dé = ll? iflskszi 

[Observe that (p’ — 1)p = p']. When these results are placed in (4.2-4), 
we have 

5 > 1/p 

|ar|? < n at ; 

k=l k=1 

whence 


i 1/p' 
(> ir) < ITI. 
k=1 


This holds for all i, so it follows that {a,} belongs to Ir. 


Example 5. Suppose | < p < oo and 1 <q < œ. Let {a,;} be an 
infinite matrix (i, j = 1,2, ---) of scalars with the following property: 
For each x = (£j) in /? the series 


oo 
n= > ajén 


j=l 
is convergent for each i, and the sequence y = {n,;} belongs to 4. Then 
the operator A defined by y = Ax is a continuous linear mapping of 
I» into H. 
To prove this we observe first of all that 


xa) = S eub; 


j=l 
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defines a continuous linear functional x; on /». If 1 < p< œ, this 
follows from the result established in Example 4, for 


Ld l/p'| œ l/p 
lx] < ( ear) (È ir) 3 
j=l j=l 


so that x;' is continuous, with 


oo i/p’ 
Ix;'ll < ($ e) « QOO. 
j=1 


(Actually, the last < can be replaced by =, but we do not need this fact 
here.) If p = 1 we have 


lx; < sup [ej] < 00; 
J 
if p = oo we have 


xli < 
j 


æ% 
layl < co. 

=1 

These latter facts result from problems 4 and 5 at the end of this section. 
Now, to prove that A is continuous, it suffices to prove that it is closed, 
by Theorem 4.2-I. Suppose that x, — x and Ax, — y. where x,. x e [P 
and yek. From x, — x we conclude x;'(x,) > x; (x) as n — oo, since 
x; is continuous. Now,ifz = {¢;} is any member of /4, £; is a continuous 
function of z, as we see from the fact that |Z;| < |z|. Since Ax, = {x,'(x,)} 
and y = (qj, we conclude from Ax, — y that x,'(x,)—>7;. But then 
7; = x; (x). This means that y = Ax. Thus A is closed, and the 
argument is complete. 


PROBLEMS 


l. Suppose that X is a linear space in which two invariant metrics are defined, 
in such a way that X is a complete metric linear space with respect to each 
metric. Suppose that the two topologies are 71, 7 2, and that 7, is stronger 
than 7, (or, equivalently, that if x, — x in the sense of 7,, then x, — x in the 
sense of 75). Then, the two topologies are actually the same. Use Theorem 
4.2-H and the identity mapping of X on itself, with the topology 7, for the 
domain and 7, for the range. 

2. Let X be a linear space with two norms ||x||;, ||xl|2, and let X be complete 
with respect to each norm. Suppose there exists M such that [xl < M|lxli, 
for every x. Then, there is also an m such that |lx|, < mlixilz. 

3. Prove Theorem 4.2-I by defining another invariant metric on X, with 
xl], = ixl + [7x]. Then use problem 1. 
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4. If > «€, is convergent whenever > lék] < co, then Sup lax] < 90. 
1 1 


Is] oo 

5. If > a,€;, is convergent whenever lim £j = 0, then x la| < co. 
I kon ] 

6. For each x € L(0, 27) let 


22 
En = xí x(r)e- i"! dt, n=0, +1, rz2-.. 
2m Jo : 


Suppose X is some closed subspace of L(0, 27) such that » \é,| < oo for each 


x€X. Show that there is some constant M such that 


9D 2n 
Died < M[ KOI dt 


for each x e X. 
7. Suppose x € L(0, 27) and 


i 1 20 x(8) 
Mss Qn Jo I= te?" 

where ¢ is complex and |r| < 1. The two following propositions are true 
(A. E. Taylor, 4, p. 41 and p. 45): l 


a. If 1 < p « œ and x e€ Lr(0, 27), then y € HP (see Example 8, $3.11 for 
the definition of HP). 
b. There exists a constant Mp, depending only on p, such that 


20 1, 22 1/ 
(x Í reje do) na m Í xor ao)” 
2v o 


0 
for all x e L^(0, 27) and all r, 0 <r « 1. 
Show that b is a consequence of a, by means of the closed-graph theorem. 


8. Prove that the operator A of Example 4, 8 1.5, is closed, with domain and 
range in L(0, oo). It suffices to deal with the case when A = 0, since the addition 
of a scalar multiple of J to a closed operator leaves a closed operator. 


4.3 The Normed Conjugate of a Normed Linear Space 


Let X be a normed linear space, and let A be the associated scalar field. 
This field is itself a Banach space, with the absolute value |«| as the 
norm of « A continuous linear operator on X into A, that is, a 
continuous linear functional on X, is an element of the space LX, A], as 
defined in $ 4.1. We shall denote this space by X’. It is a subspace of 
_Xf, The space X' becomes a Banach space if 
(4.3-1) Ix’ = sup [xœ 


When X' is normed in this way, we call it the normed conjugate of X. 
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Some authors call X’ the dual of X ; others call it the adjoint of X. 
Sometimes it is denoted by Y* or by X. 

Our first concern is to establish the fact that X’ has sufficiently many 
elements to meet our needs in some situations which will soon arise. 
For what follows the reader will need to refer back to $ 3.7. 


Theorem 4.3-A. Suppose M is a proper subspace of the normed 
linear space X. If m e M', X' contains an element x' such that 
[x| = lim'|| and x'(x) = m'(x) if x e M. 


PROOF. We define p(x) = |m] xl, x e X. Then p is a norm on X. 
We observe that |m'(x)| « p(x) if x e M. We apply Theorem 3.7-B, 
taking m and x’ in place of the f and F of the theorem referred to. Then 
|x' GO»! < lmi lxi] for each x in X. This implies that x' e X' and 
ix l| < lm'l. But jml} < lix'|, as a result of the fact that x’ is an extension 
of m'. "Thus all is proved. 

Theorem 4.3-A is commonly called the Hahn-Banach theorem. 

A. number of simple but important consequences follow rapidly from 
Theorem 4.3-A. 


Theorem 4.3-B. If X is a normed linear space, and xo € X with 


Xo % 0, then there exists x' € X' such that |x'|| = 1 and x'(xo) = |xgl. As 
a consequence we have ' 
(4.3-2) Sup. x'e) = ixil 


for each x € X. 


PROOF. Let M be the subspace of X generated by xo. If x = «xg, 
define m'(x) = e|xgl. It is clear that m'e M’ and |lm'||= 1. The 
existence of the required x' now follows from Theorem 4.3-A.  Verifica- 
tion of (4.3-2) is left to the reader. 


Theorem 4.3-C. Suppose x is an element of the normed linear space 
X such that x'(x) = 0 for every x' € X’. Then x =Q. 


PROOF. Apply (4.3-2). 


Theorem 4.3-D. Let X be a normed linear space, and let Xo be a sub- 
space of X. Suppose there exists an x, in X at a positive distance h from 
Xo. (This will be the case if Xy is closed and a proper subset of X, in which 
case x, may be any element of X — Xy) Then, there exists x' € X' such 
that x'(xi) = h, \\x’|| = 1, and x'(x) = 0 if x € Xo. 


PROOF. First we give a demonstration, based on Theorem 4.3-A. 
This argument is most convenient for readers interested primarily in 
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normed linear spaces, if they have not studied §§ 3.5, 3.6 in detail. After 
that we show the relation of Theorem 4.3-D to Theorem 3.6-E and in so 
doing indicate an alternative proof. 

Let M be the subspace generated by X; and xı. Elements of M are 
representable in the form m = ox, + x, x € Xo; « and x are uniquely 
determined by m, because x, is not in Xp. Let us define m’ by 
m'(m) = ah. We shall show that mw € M' and [jm'|| = 1. If œ z 0 we 
have |n| = lex, + xij = || —a(— aix — x) > |alh, because — a-ix 
€ X, and the distance from x, to Xj is ^. Thus |m'(m)| = |«|h < lm] if 
«#0. This inequality is obviously true if « — 0. Consequently 
m € M' and |m'| < 1. Now, if e > 0 there exists x € Xy such that 
lx — xil <h +e Let 


X—3X 


TED ss osi 


Then y € M, ||y|| = 1, and 


r h h 
m) = ix— sx? hte 


Consequently |\m'|| > 


7 f n Since h #0 and this is true for every 
e > 0, we conclude that |m'i| > 1. Observe that m'(xj) = h and that 
m'(x) = 0 if x eX. The existence of the required x’ € X’ now follows 
from Theorem 4.3-A. 

To show the relation of Theorem 4.3-D to Theorem 3.6-E, let 
K-íx:ilx — x,|| < h}. Then K and X, do not intersect. Theorem 
3.6-E shows that there exists a closed hyperplane which contains X and 
is such that K lies strictly on one side of it. Since 0 € Xo, by Theorem 
3.5-E the hyperplane is the set (x:x'(x) = 0}, where x’ is some element of 
X'. Byreplacing x' with some constant multiple of itself, we can arrange 
matters so that x'(xj) has any specified nonzero value. We choose to 
make x'(xj) = h. Then x'(x) > Oif x e K. The remainder of the proof 
consists in showing that |x'| = 1. Suppose that y is any vector for 
which ||y| < l. Then x; * hpeK, and so 0< x(x, + hy) = 
h + hx(y) From this we obtain — 1 < x(y) « 1. It follows that 
|x'(x)| < 1 if |x| < 1. Hence |x'| < 1. On the other hand, we can 
choose a sequence {y,} from Xə so that |y,-— x,|| >A. Let 
Za = |y, — xil, — x1). Thenliz,| = Land x'(z,) = — Ally, — xilt, 
so that |x’(z,)| > 1. Hence ||x’|| > 1, and the proof is complete. 

The next two theorems show some uses of the Hahn-Banach theorem 
and its immediate consequences. 


Theorem 4.3-E. Jf X' is separable, so is X. 
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PROOF. Let {x,'} be a countable set which is everywhere dense on the 
set {xix = 1} in X'. Choose x,€X so that jjx,|| = 1 and 
x, (x,)| 2 3/4. Let M be the closed linear manifold in X generated by 
the sequence {x,}. Suppose M z X and xye X — M. Then Theorem 
4.3- D tells us that there exists x’ € X’ such that |x'|| = 1, x'(xo) # 0, and 
x(x)- 0ifxeM. Then x(x,)) = 0 ifn = 1, 2,---, and 


$ « [xn On) s 1x/G) — x'Gu)| + 1x'Gol. 
whence 
å «Ix, — xlix, = lix, — x'Il. 


This contradicts the fact that ||x,’ — x'| can be made as small as we 
please by suitable choice of n. Hence M = X. It then follows that 
linear combinations formed from {x,} with rational scalar coefficients 
constitute a countable set everywhere dense in X, so that X is separable. 

We shall see that X can be separable and X' not, so that the converse 
of Theorem 4.3-E is false. For example, /! is separable, but it turns out 
(see Theorem 4.32-A) that (/!)' is congruent to /^, which is not separable. 

The next theorem involves the concept of a quotient space as a normed 
linear space (see $ 3.14). 


Theorem 4.3-F. Let X be a normed linear space and M a subspace 
of it. Let M? = (x eX':x(x) 20 if xe My). Then M? is a closed 
subspace of X', and the conjugate space M' is congruent to X'[M9. 


PROOF. It is evident that M? is a closed subspace. In what follows we 
use m and m' for typical elements of M and M', respectively. A typical 
element of X'/M? is [x], where x’ € X’. We have y' € [x'] if and only if 
y — x € M°, ie, y'(m) = x'(m) for every m. With [x] given we 
. define m by m'(m) = y'(m), where y' e[x']. Clearly m’ depends only on 
[x] and not on the particular y' chosen. Also, m'e M'. Now 
[m'Gn)| < lly'll lll, and so, by the way in which |l[x']l is defined, we 
conclude that ||m’|| < ||[x’]||. On the other hand, Theorem 4.3-A shows 
that there exists some y' € [x'] with ||y’|| = |m'|. Therefore 


ix] = inf jy") < l'l. 
y'eix'] 


Thus ||\m'|| = li[x']|. If we write m = T([x'], we see that T defines a 
linear and isometric mapping of X'/M? into M'. The range of T is in 
fact all of M’, for if m' € M’, and x’ e X' is such that x'(m) = m'(m) when 
m € M, we have m = T([x]. Such an x’ exists, by Theorem 4.3-A. 
This completes the proof. 

The Hahn-Banach theorem can be used to prove an existence theorem 
for Green's function for the Dirichlet problem, under certain conditions. 
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We present a brief sketch of the line of argument of this proof. For 
simplicity we consider the two-dimensional case. 

Let D be a bounded, connected open set in the plane, with boundary 
C consisting of a finite number of smooth curves. Let B be the real 
Banach space of continuous functions f defined on C, with ||f|| = the 
maximum value of |f| on C. Let B, be the linear manifold in B consisting 
of those f for which the Dirichlet problem for the region D is solvable 
(see the discussion of Example 1, $1.5). With each point Qe D we 
associate a continuous linear functional / defined on Bo, the value of / at 
f € By being u(Q), where u is the solution of the Dirichlet problem for 
the boundary-value function f. That is, u is harmonic in D, continuous 
in D, and u = fon C. This functional/islinear. Since u = 1 if f = 1, 
and since |u(Q)| < maximum of | f| on C (by the maximum-value theorem 
for harmonic functions), it is evident that /& Bọ and || = 1. By 
Theorem 4.3-A there exists an element L of B' which is an extension of / 
and for which ||| = 1. We shall denote L by Lg to exhibit its dependence 
on Q. 

Now let P be any point not on C in the plane. If f represents a point 
on C, let g»(f) = log tP. Note that gp € By if P is in the complement of 


D. The value at Q of the corresponding solution of the Dirichlet problem 


is u(Q) = (gp) = log OP. Now, for any fixed P not on C, gp is an 
element of B, and so we can apply Lg to gp; we define 


k(P, Q) = Lo(gp). 
If P is on C (and Q is in D), we define 


k(P, Q) = log QP. 
We then define 


for Qe D and any P. We assert that G is Green's function (to be 
considered as a function of P with singularity, or "pole," at Q). To 
show this it is merely necessary to prove that, as a function of P, k(P, Q) 
is continuous on the set D and harmonic in D. Let dp denote the 
Laplacian operator. Then, for P in D, 


Apk(P, Q) = Lol4pgp) = Lo(0) = 0. 


The commuting of 4p and Lg is justified by the fact that Lọ is a bounded 
operator, just as in differentiating under an integral sign. Hence 
K(P, Q) is harmonic in D. All that remains is to prove continuity of 
K(P, Q) at points P on C. 
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We know that Lo(gp) = log OP if Q € D and P is not in D. Hence, 
if Py € C and AR — P, from outside of D, it follows that k(R, Q) ^ 
log QP, = k(Pp, Q). We want to prove that k(P, Q) — k(Po, Q) as P— Po 
from inside C. It will suffice to show that, with each point P sufficiently 
near Pg and in D, we can associate a point R not in D such that R — Po 
and k(P, Q) — k(R, Q) — 0 as P — Py. We demonstrate this as follows. 
With P given, draw a straight line from P to a nearest point N of C; this 
line is normal to C at N. Continue the line beyond N to a point R such 
that PN = NR. If P is sufficiently near Po, R will not bein D. We have 


K(P, Q) m K(R, Q) = Lol gp m £x). 
gp(t) — galt) = log = 


It can be proved that, as P — Py, R — Py and 


uniformly with respect to t on C. Thus ||gp — gal — 0. The desired 
result now follows, owing to the continuity of the linear functional Lo. 

For more details on this subject, see the papers by P. D. Lax and 
C. Miranda listed in the bibliography. 

If X is an incomplete normed linear space, and X is the completion of 
X (see § 3.13), it turns out that X’ and X’ are congruent, and it is 
convenient to regard X' and £’ as being the same space. The fact that 
they are congruent follows from Theorem 3.13-A, with Y the space of 
scalars. 


PROBLEMS 


|. If X is a normed linear space of finite dimension n, the dimension of X’ 
is also n. Prove this by showing that X’ = Xf. See Theorem 1.61-A and the 
proof of Theorem 3.12-A. 

2. The proposition in (1) can be, generalized. If X is an n-dimensional 
topological linear T,-space, all the elements of X^ are continuous, and X/ is 
n-dimensional. See problems 1 and 2 of § 3.3. 

3. If X is a complex normed linear space and X, is the associated real linear 
space, we write x(x) = xj'G) — ix('(ix), where xj! € (X,)' and x’ e X' (see 
83.7). Show that jx] = jx]. 

4. Suppose M is a subspace of the normed linear space X. Let G= MA 
{x:||x]| < 1}. Suppose x9’ € M9. Show that the distance from x)’ to M? is 
sup [xo (x)| and that there is in M? an element x’ such that |x — x| = 
xe 


d(xy', M9). 
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5. If X is a Banach space of infinite dimension, its dimension (see problem 2, 
§ 1.72) is at least as great as the cardinality C of the set of all real numbers. 
The proof is made (a) by observing that the dimension of /? is at least as great 
as C, and (b) by constructing a one-to-one linear mapping of /© into X. For 
(a) consider the elements (4, 72, 4, ---) of 1°, where O< t « 1. For (b) 
construct a sequence {x,} of elements of X and a sequence {M,} of closed 


subspaces of X such that bj lx] < oo, x, € Mn xy € M, if k >n. Then, if 
y = (£j elo, define Ty = x = > &,x,; T is the desired mapping of 1% into 


i 

X. To obtain (M,) and {x,} let Mo = X and for n > 1 choose m,’ e Ml 
with m,' # 0; then define M, = (x € M, 1:m, (x) = 0} and choose x, € M, 1 
— M, in a suitable way. 

6. 1f X is an infinite-dimensional separable Banach space, its dimension is C. 
This can be shown by using the results of the foregoing problem and of problem 
2, 8 1.72, for the cardinality of X cannot exceed C. 

7. If X is a Banach space of infinite dimension, the weak topology 7(X, X") 
for X is not metrizable. Use problem 5 and $ 3.9, problem 2. 


8. Let X be a normed linear space and M a subspace of X'. If M is not 
closed, then 7(X, M) is strictly stronger than 7 (X, M) (see § 3.81). However, 
if S is a bounded subset of X, the relative topologies induced on S by Z(X, M) 
and Z(X, M) are the same. To prove this it suffices to show that, if e > 0 
and x,', ++, x,’ are in M, the set VA S, where V = (x:|xi/G9| < e i = 1, 
-** n}, is open in the topology induced on $ by Z(X, M). 


4.31 The Second Normed Conjugate Space 


If X is a normed linear space, we denote the normed conjugate of X’ 
by X". We shall use x" as a typical notation for elements of X”, and we 
shall often write <x’, x”) in place of x”(x’). 

Note that, although X' is a subspace of X/, X" is not in general a 
subspace of X/f (though it is a subspace of (X')/). There is, however, 
a canonical mapping of X into X" which is similar to the canonical 
mapping of X into Y//, as defined in $ 1.6. We shall use the symbol J 
for this canonical mapping of X into X”, in spite of the fact that it is not 
the same as the J of $1.6. Since we do not consider both mappings at 
the same time, no confusion need arise. 

The definition of the canonical mapping of X into X" is expressed by 
the formula 


(4.31-1) (x, Jx» = (x, x5, x eX, x EX’, * 


That is, Jx = x", where x(x’) = x'(x). It is evident that x” € (X), and 
since |x"(x’)| < ||x’|| ||xl|, itis clear that x" € X" and ||x"|| < ]|xl. Actually, 
we can prove that ||x”|| = ||x||. This is obviously so if x = 0, and so we 
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assume x #0. Then, there exists x’ eX’ such that [||x'|- 1 and 
x'(x) = ||x|| (Theorem 4.3-B). By the formula for |x"|| corresponding to 
(4.3-1) we see then that |x"| > ||xl. Hence |x"|| = ||x||. We state this 


result for reference in the form 
(4.312) Jx] = Ilxll. 
Evidently J sets up a congruence between X and a subspace of Y". 


Definition. If the range of Jis all of X”, we say that X is norm reflexive. 
If the exact context is clear, we may use the simpler term reflexive 
instead of norm reflexive. But it should be recalled that we have already - 
(in § 1.6) defined a concept of algebraic reflexivity for a linear space. In 
contrast to the situation with algebraic reflexivity, we shall see that there 

exist infinite-dimensional spaces which are norm reflexive. : 
Since X" is complete, whether X is or not, it is clear from (4.31—2) that, 
if X is incomplete, it cannot be reflexive. 


Theorem 4.31-A. Jf X is norm reflexive, so is X’. - 


PROOF. The argument is very straightforward. Denote by Jo the 
canonical mapping of X into X", and by J, that of X’ into X". We 
assume &(Jy) = X". and we wish to prove Z(J4) = X". Suppose x" e X", 
and define x’ by <x, x'» = <Jox, x"», x varying over X. The proof is 
then completed by proving that x’ eX’ and J,x' = x". We leave the 
last details to the reader. 

It will be shown in § 4.6 (problem 4) that, if X is complete and X’ is 
norm reflexive, so is X. 


Theorem 4.31-B. Jf X is norm reflexive, the same is true of each 
closed subspace of X. 


PROOF. Let M be a closed subspace of X. We use Theorem 4.3-F and 
the notation employed in its proof. In particular, we use the operator T 
which maps X'/M?9 isometrically and linearly onto M’. Suppose 
m" € M". Define x” e X" by setting x'(x') = m'(T([x ])) for each x’ in 
X'. Since X is reflexive, there exists x € X such that x'(x') 2 x'(x) for 
each x’. We assert that xe M. For, if not, the fact that M is closed 
enables us to infer that there exists x' € X' such that x'e M? and 
x'(x) z 0 (by Theorem 4.3-D). Then [x'] is the zero element of X'/M?, 
and so 7([x']) = 0, whence x'(x) = x"(x’) = m’{T([x’])} = 0, contrary to 
fact. Let us now denote x by m, since x € M. If m = T[x'] is any 
element of M’, we have m'(m) = x'(m), by the way in which T is defined. 
Thus m"(m') = x'(x') = x'(m) = m'(m). This proves that M is reflexive. 
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PROBLEMS 


l. A finite-dimensional normed linear space is norm reflexive. 
‘2, The range of J is closed in Y" if and only if X is complete. " 
3. If X is complete but not norm reflexive, J(X) is of the first category in X. 


4.32 Some Representations of Linear Functionals 


, In this section we shall obtain representation theorems for linear 
functionals on certain particular normed linear spaces. These represent- 
ation theorems are of the following sort: If X is a certain given space, 
we find another normed linear space Y which is congruent to X’ in such 
a way that, if x' e X’ and if the corresponding element of Y is y, for 
each x € X the value of x'(x) is expressed in a well-determined way by an 
analytical process involving x and y. This process usually involves an 
infinite series or some kind of an integral. 
Several important results are given as problems. 


THE NORMED CONJUGATE OF ?, Ixp«o 


The spaces /? were discussed in $ 3.11. With each p we associate p’, defined 
as follows: 


i= — i < < 
Pe ud ifi<p< ©, 
p -o if p — 1, 
p -1 if p = o 
Note that (p’)’ = p and that 
(4.32-1) low 3d xp 
p p 


Note also that p' — 2 if and only if p — 2, and that 1 « p « 2 implies 
2 « p' <œ. 
For general use, here and elsewhere, we define 


0 ifc-0 


Me. Abeoti 

n 

Here c mày be any real or complex number. Sometimes it is convenient in 
printing to denote sgn č by sgn c, especially if c is replaced by a lengthy or 
bulky expression. Observe that c sgn č = |c|, and that |sgn c| — O or 1 
according to whether c is 0 or 4 0. 
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If x = (£,) € IP, we denote by u, that x for which £, = 1 and é, = O if n z k. 
If 1 < p « œ, we see that for any x e lP 


as n — oo, so that 


(4.32-2) x= > Gu. 
1 

It follows that 

(4.32-3) x(x) = > &x' (up) 
1 


if x’ €X’. The condition p < © is essential for (4.32-2). 

The problem of representing x’ is now seen to be the problem of describing 
what sets of values are admissible for x'(uj), k = 1, 2, ++», and of giving a 
formula for ||x’|! in terms of these values. The solution of the problem is given 
in the following theorem. 

Theorem 4.32-A. Suppose! € p « oo. Every continuous linear func- 
tional on I? is representable in one and only one way in the form 

oo 
(4.32-4) x(x) = > ad, 

1 
where the sequence a = (o,) is an element of [v Every element a of I» can 
be used in this way to define an element of (I^), and the correspondence 
between x' and a is a congruence of (IP) and l”. In particular, 


(4.32-5) 


PROOF. Suppose x'c(/») given. Define o, = x'(u). Then x'(x) is 
given by (4.32-3), or (4.32-4). Suppose first that 1 < p < œ. The 
case p = 1 is considered later. For a given positive integer n, choose x 
as follows: 

[o7 7! sgn a, ifl<k<n 
4.32- = 
Oe) ér là ifn < k. 
Then, if 1 < k <n, 


arék = |ar|” =é]? 
and so e E 


n 


n lp 
iat = (> iu] y Ss» 
1 


1 
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But |x'(x)| < |{x’|| ixl, and so 


n n Ip 
>, led” < v: «rJ 


it follows that : 


n l/p 
(> iir] < ix 


1 
Hence a = {a,} is in I7, and llal| < |x}. 


Suppose, on the other hand, that a = {a,} is a given element of Ir. 
We can define x’ € (/r) by (4.32-4). By Hólder's inequality we have 


co ip [ 2 1/p . 
J < o |? é , = jal] |||), 
|x'(x)| «(x | ) (Èa 


so that |x'|| < llall. Since x'(w,) = e, in this case it follows from the 
preceding work that ljal] < ||x'|. Hence ilal] = |ix'||, and all is clear when 
l<p<o. 

If p = 1 we replace (4.32-6) by 


on sgnà&, ifk =n 
k |0 if k x n. 


Then ||xi| < 1, and (4.32-4) becomes x'(x) = |e,|, so that |e,| < iix" lixtl 
< |x'|, whence a = {a,} € 1”, with |a|| < ||x’||. The rest of the argument 
for p = 1 is left to the reader. 

Theorem 4.32-A is not true for the case p = oo. If it were, (/%)’ 
would be congruent to the separable space /!. Since /* is not separable, 
this would contradict Theorem 4.3-E. 


THE NORMED CONJUGATE OF C[a, b] 


For the definition of C[a, b] see Example 3, § 1.3 and Example 4, $3.11, We 
shall also have to consider B[a, b] (Example 3, § 3.11), of which C[a, b] is a 
subspace. l 

Our problem is to discover an analytic representation for all continuous 
linear functionals on C[a, b]. We shall see that to each such functional x’ 
corresponds a function of bounded variation v such that the values of the 
functional are given by the Riemann-Stieltjes integral 


b 
(4.32-7) x(x) = f x(t) de(t). 
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Theorem 4.32-B. Suppose x’ € X', where X = C[a, b]. Then, there 
exists a function of bounded variation v, defined on |a, b] and with values in 
the scalar field associated with X, such that (4.32-7) is valid for each x and 
also such that the total variation of v on [a, b] is |ix' ||. 


PROOF. Let f be a continuous linear functional on B[a, b] which is an 
extension of x’ and such that [|/|| = |x’. Such an f exists, by Theorem 
4.3-A. Ifsis any point of [a, b], let x, be defined by x,(t) = 0 (for s = a) 


and by 
1 ifa<t<s 
1) = 
x) i ifs<1<b 


in casea < s <b. Then x, € Bla, b]. We define v by 
(4.32-8) v(s) = f(x;). 
We now proceed to show that v is of bounded variation and that 
Viv) < |x’, where V(v) is the total variation of v. Consider any 
partition of [a, b]: 

a-—ty «t «c: « t — b. 
Using the sgn notation explained earlier, we let 

& = sgn [v(t;) = v(t;_1)], i= l, ty M, 
and we construct the function 
ifftu«t«t 
wo - (2 Ed CN 

€; iftjs1<t<t, i=2,---,7. 

Then y € Bia, b) and ||y] < 1. We can write 


x(t) = > elyi(t) — yi-1(0], 
i=1 
where y, = x,. Thus 


n n 


fo) = > «alfo = foco] = >, sE) — otid) 
i=l i-i : 
a jolt) — Vti) 


i= 


But | f(y) < IAH < {fll = Ixl. Therefore 


> [od — v2) < Inl. 
i=l 
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This shows that v is of bounded variation, with V(v) < x". 

Now we proceed to prove the validity of (4.32-7). With the same 
notation as before for an arbitrary partition, and with any given x in 
C[a, b], we define z € Bla, b] as follows: 


n 


2) = > xt apo - 0-0. 


il 
Then 


n 


(4.32-9) f(z) = > x(t it) — vtl. 


i=l 


Also, 


at) = x9 = { 


|x(to) — x(£)| ifa<t<t 
Ix.) xD) if tia ett, i-2,-- n. 


Let 4 denote the partition, and let 
i4] — max (lt; = tol, Nets |t, E Lal) 


Then we see (by the uniform continuity of x) that ||z — xj| — 0 wher’ 
[4| +0. Since f is continuous, f(z) > f(x). But also, it is clear from 
(4.32-9) and the definition of a Stieltjes integral that 


b 
fay f x(t) dv(t). 
We therefore conclude that 
f(x) = f x(t) de(t). 


This is the same as (4.32-7), since fis an extension of x’. It is a standard 
property of Stieltjes integrals that 


b 
(4.32-10) | f x(t) do(t)| < lix Vo). 


Consequently |ix'| < V(v). We already know that V(v) < |jx'|, and so 
V(v) = |ix']l. 


Theorem 4.32-B makes no assertion about the uniqueness of v, nor 
does it assert that X' is congruent to some space of which v is a member. 
We observe in the first place that there is no unique function of bounded 
variation which makes (4.32-7) true for all x e C[a, b]. For, we can 
add an arbitrary constant.to v without affecting (4.32-7). It is also easy 
to see that the values of v at its points of discontinuity in the interior of 
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the interval [a, b] can be altered without affecting the value of the integral 
in (4.32-7). For, if w is a function of bounded variation which is equal 
to v at a, b and at all points ¢ in the interior of (a, b] at which vis continuous, 
the approximating sums which define 


b b 
| x(t) dot) and f x(t) dw(1) 


can be formed exclusively by use of values of v and w at points of the 
aforementioned kind, so that the integrals must be equal in value. 

In order to obtain a congruence between the space X' and a suitable 
space of functions of bounded variation, we proceed in the following 
manner. As in Example 7, $3.11, we denote by BV[a, b] the Banach 
space of functions of bounded variation defined on [a, b], with 


lio = |v(a)| + Yo). 
We can define an equivalence relation in BV[a, b] by writing v, ~ v; if 
b b 
[x0 ao = [ x0 dos 


for each x € Cfa, b]. We assert that v ~ 0 if and only if v(a) = v(b) and 
v(e — 0) = x(c + 0) = c(a) ifa < c < b. To see this we observe first of 
all that v ~ 0 implies 


b 
TE i dolt) = v(b) — v(a). 
Next we observe the following: If v e BV[a, b] and a < c < b, then 
] fe*^ 
(4.32-11) i f v(t) dt — v(c + 0) 
as h—>0. Likewise, ifa < c « b, 
(4.32-12) ; f ond ae 20) 
c—h 


ash—-0. We leave the simple proofs of these facts to the reader. Now 
suppose that a < c < b, 0 < h < b — c, and define 


1, a<t<e 
t—c 
x) 241— y c&t&ch 
0, cth&txb. 


Then v ~ 0 implies 


b cth 
0 = Í x(t) dw(f) = wc) — v(a) + f x(t) de(t). 
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On integration by parts we obtain 
ch ] feth 
f x(t) dut) = — v(a) + if v(t) dt. 


Using (4.32-11), we obtain the result (c + 0) = v(a). A similar argument 
shows that v(c — 0) = w(b)ifa < c < b. [We remark that v(a + 0) = v(a) 
is a consequence of v(c + 0) = v(a) for a < c < b, because there exists 
a sequence c, such that a < c, < b, c,->a, and v(e, + 0) = v(c,); 
likewise for v(b — 0) = w(b).] l 

Conversely, it is evident that, if v € BV [a, b] and v(a) = v(b) = v(e + 0) 
= v(e — 0) when a < c < b, then v ~ 0. For then v(t) = v(a) at t = a, 
t = b, and all interior points of [a, b] at which v is continuous, so that, 
if x € C[a, b], 


b b 
f OHE Í x(t) dw(r) = 0, 


where w(t) = v(a). 

Now let X = C[a, b]. We wish to associate with each x’ € X’ a unique 
v € BV{a, b] in such a way that the association makes X" congruent to a 
subspace of BV[a, b], and such that x’ and v are related by the formula 
(4.32-T). We do this by introducing the concept of a normalized function 
of bounded variation. We shall say that v is normalized if v(a) = 0 and 
if v(t + 0) = v(t) when a < t < b. Other definitions of normalization 
can be used; we might alternatively require v(t — 0) = v(t), or 


v(t) = tolt + 0) + e — 0)]. 


Our choice is governed by consideration of some future applications. 

The normalized functions form a linear manifold in BV[a, b]. Each 
equivalence class contains at most one normalized function. These facts 
are readily evident. From any ve BV[a, b] we can define another 
member v* of BV [a, b] as follows: 


v*(a) = 0, v*(b) = v(b) — v(a) 

v*(f) = wt--0)—vwa, a«t«b. 
Then one can easily verify that v* is normalized and that v* ~ v. Thus 
each equivalence class contains exactly one normalized function. Finally, 
one may show that V(v*) < V(v) For, suppose a = fo € f <. 


<t — b. If e » 0 we can choose points Si, **:, 5,1, at which v is 
continuous, with 5, so close to 7; (on the right) that 


\u(t, + 0) — v(s)| < «/2n. 


200 INTRODUCTION TO FUNCTIONAL ANALYSIS [$4.32 
It is then readily seen that, if sọ = a and s, = b, we have 


> e*t) = v* 0| < > Ino = e| ex VO) + 6 
k=1 k=1 
and so Viv*) < Viv) + e. But then V(v*) < V(v). 

We can now state: 


Theorem 4.32-C. Let X = C(a, b]. Then X' is congruent to the 
subspace of BV([a, b] consisting of all normalized functions of bounded 
variation. If v is such a normalized function, the corresponding x’ is given by 


b 
(4.32-13) x'(x) = Í x(t) dv(?). 


PROOF. Formula (4.32-13) defines a linear mapping x' — Tv, where v 
is normalized and x’ € X’. We evidently have ||x’|| < V(v) [see (4.32-10)]. 
For a normalized v, V(v) is the norm of v, because v(a) = 0. Now 
consider any x’ €X’. Theorem 4.32-B tells us that there is some 
u € BV[a, b] such that 


x(x) = i x(t) du(s) 


and V(u) = |x". The integral is not changed if we replace u by u*. 
Then x’ = Tu* and ||x'| < V(u*). Also, V(u*) < V(u) = |x'|. There- 
fore [[x'|| = V(u*). Since there is just one normalized function in each 
equivalance class, we see that the theorem is proved. 

The following theorem is of interest, especially in relation to § 7.5. 


Theorem 4.32-D. Suppose the functional x’ is defined by formula 
(4.32-7), where v is of bounded variation. Suppose also that x'(x) > 0 if 
x € C[a, b] and x(t) 2 0 for all values of t on [a, b]. Then v(a) < v(s + 0) 
X v(b) if a < s< b and v(s; + 0) < v(s + 0) fas «so «b. In 
particular, v is nondecreasing if it is normalized. 


PROOF. We shall not go into full detail with the argument. The 
fundamental idea of the proof rests on the following consideration: If 
a € s « b and 0 < h « b — s,let x be the function defined by x(4) = 1 if 
agt<s, xt) -(s-h—fD/h if s<t<st+h, and x(t)=0 if 
Sth<t<b. Then x(x) 2 0. A rather easy calculation shows that, 
as h — 0, 


f dase + 0) — sa) 


Thus v(a) < v(s + 0). The rest of the proof is left to the reader. 
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PROBLEMS 


l. Let (c) denote the space of sequences x = (£,) such that lim £, = £j exists. 
Let |x|| = sup |£,|J. Then (c) is a subspace of /~. Show that it is complete. 


Let ug be the x for which £, = 1 for every n, and let uj, u2, -+- be as in the 
discussion of /?. Show that 


x = Égug + 2: (£x — £gus. 
i 


eo 


If x’ e(c)’ and x'(uj) = «p, show by special choice of x that > exl < œ. 
i 


Then in general we can write 


x(x)- (s — > ex) fo + 2, 
1 


Show that (c)' is congruent to /! under the correspondence x’ ++ 6 = (B,), where 


xp = X ber 
1 


D Let (co) be the closed subspace of (c) consisting of those x e (c) for which 
é,=>0. Show that (cj) is congruent to /! under the correspondence 
o 


x a= (o), where x'(x) = > OE ke 
1 


3. If | < p « œ, then /? is norm reflexive. 

4. |! is not norm reflexive. 

5. (c) and (cg) are not norm reflexive. 

6. State and prove a representation theorem for /7(n), 1 € p « oo. 


7. Let (a, b) be a finite or infinite interval of the real axis. The general 
representation of a continuous linear functional on L(a, b), if 1 « p < œ, is 


b 
x(x) = f v(£)x(t) dt, 


where v € Lr'(a, b). The correspondence x’ e» v is a congruence of (LPY and 
Lr’. See Banach, 1, pages 61-65 and Riesz and Nagy, 1, page 78. A more 
general form of this representation theorem is given in 8 7.4. 


,44 The Principle of Uniform Boundedness 


In this section we have several theorems, in each of which the conclusion 
is that a certain set in a certain normed linear space is bounded. In some 
cases the space is a space of continuous linear operators. It is convenient 
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to state several theorems, even though, in a certain sense, they are all 
derivable from one general theorem. For the purpose of applications it 
is better to state the results in various forms adapted to easy recognition 
in the various situations where they are needed. But there is a single 
fundamental principle underlying all the theorems. This principle goes 
back to the fact that a complete metric space is of the second category in 
itself. Our proofs use this fact through the medium of the closed-graph 
theorem (Theorem 4.2-1). 

To avoid trivial situations we assume throughout that we deal with 
linear spaces which contain some nonzero elements. 


Theorem 4.4-A. Let X be a normed linear space, and let F be a 
nonempty subset of X. Suppose that sup |x'(x)| < oo for each x’ € X’. 
xeF 


Then sup ||x| < oo (i.e., F is a bounded set). 
xeF 


This theorem is merely a special case of the next theorem, but we state 
Theorem 4.4-A separately to make the nature of the principle of uniform 
boundedness stand out clearly before we embark upon more general 
theorems. : 

Theorem 4.4-A can be given a geometric interpretation by using the 
notion of a hyperplane. A closed hyperplane through 0 is a set of the 
form (x:x'(x) = 0}, where x’ is some element of X’. The set 
{x:|x’(x)| < a} (where « > 0) is then the set of all points between the 
two closed hyperplanes íx:x'(x) = oj, (x:x'(x) = — a}, which are 
parallel to one through the origin, and at equal distances from it on 
opposite sides of 0. Theorem 4.4-A states that, if for every closed 
hyperplane L through 0 the set F lies in.some open “‘slab” between two 
closed hyperplanes parallel to L, then F is bounded. 

To generalize Theorem 4.4-A we propose to draw the same conclusion 
as before but with the weaker assumption that sup |x'(x)| < oo for each 

xe. 


x' € M, where M is merely a subset of X' but of a suitably special nature. 


Definition. If M is a linear manifold in X' and x € X, let 


(4.4-1) PX) = sup |x'(x)| for x’ e M and ||x’|| = 1. 
Let 
(4.42) (M) = inf p(x) for x e X and ||x|| = 1. 


We call (M) the characteristic of M. If v(M) > 0, M is said to be 
norm-determining for X. 


$4.4] GENERAL THEOREMS ON LINEAR OPERATORS 203 
It is evident that 


(4.4-3) «(M)lxi < pO) < Tet 


and that 0 < (M) < 1. If (M) > 0, then pm is evidently a norm on 
X, and the topology for X defined by using this norm is the same as the 
topology for X defined by using ||x/| as norm. 


Theorem 4.4-B. Let F be a nonempty subset of the normed linear 
space X, and let M be a closed linear manifold in X' which is norm- 
determining for X. Suppose that sup|x'(x) < oo for each x' eM. 

xeF 


Then F is a bounded set. 


PROOF. Consider B(F), the Banach space of all bounded scalar-valued 
functions f defined on F, with |f|| = sup |f(x). Define'a linear operator 
xeF 


T with domain M and range in B(F) by defining Tx' to be the element of 
B(F) whose value at x is x'(x). The hypothesis assures that Tx’ € B(F), 
and T is obviously linear. Since ||x,’ — x'| > 0 implies x,'(x) — x'(x) for 
each x € X, it is a simple matter (using Theorem 4.2-A) to verify that T 
is a closed operator. But, since M and B(F) are both complete, it follows 
by the closed-graph theorem that T is continuous. Hence |x'(x)| < 
ITI llx^i| if x e F and x € M. It follows that v(M)lxl| < p) x 1T if 
x€F. Since v(M) > 0, the fact that F is bounded now follows at once. 

If M = X', then pax) = [ixl by (4.3-2. Hence (M) = 1 in this 
case. It is then clear that Theorem 4.4-A is just a special case of 
Theorem 4.4—B. 

Next we consider X’ and X". If J is the operator which maps X 
canonically into X", the range of J is a subspace of X^ which is norm- 
determining for X’. In fact, the characteristic of Z(J) is 1, as we see by 
examining the definition of »(2(J)) and recalling the definition of |x’. 
It is furthermore true that, if X is complete, 2(J) is closed in X". We 
can therefore apply Theorem 4.4-B to subsets of X’, using A(/) for the 
role of M. This gives us the result: 


Theorem 4.4-C. Let X be a Banach space, and let F be a subset of 
X’. Suppose that sup |x'(x)| < oo for each x e X. Then Sup Ix’ < oo. 
x'eF x'e 


As immediate application of Theorems 4.4-A and 4.4-C we have: 


Theorem 4.4-D. (a) Let (x,) be a sequence in the normed linear space 
X such that lim x'(x,) exists for each x' e X. Then the sequence of norms 


xnl] is bounded. 


204 INTRODUCTION TO FUNCTIONAL ANALYSIS [§ 4.4 


(b) Let X be a Banach space, and let {x,'} be a sequence in X' such 
that lim x,'(x) exists for each x € X. Then, the sequence of norms ||x,/|| is 
no 


bounded. 


We can formulate a theorem similar to Theorem 4.4-B, dealing with 
uniform boundedness of a set of bounded linear operators. Let X and 
Y be normed linear spaces, and let Z be a subspace of X. If T e LX, Y], 
define 


q2(T) = sup ||Tx|| for x eZ and |x| = 1. 


Then define 
(Z) = inf gz(T) for T e [X, Y] and ||T|| = 1. 


If (Z) > 0, we shall say that Z is norm-determining for [X, Y]. [Note 
that (X) = 1.] Evidently 0 < (Z) < 1 and 


eZ) TI < q2(T) < ITI. 


We have the following result: 


Theorem 4.4-E. Suppose X is a Banach space, and let Y be a normed 
linear space. Let Z be a closed subspace of X which is norm-determining 
for [X, Y]. Let G be a nonempty subset of [X, Y] such that sup ||Tx|| < oo 

TeG 


for each x €Z. Then sup ||T|| < oo. 
TeG 


PROOF. The argument is essentially similar to that in the proof of 
Theorem 4.4-B. First of all, we observe that it suffices to prove the theorem 
with the added assumption that Y is complete. For, if Y is not complete 
and f is its completion, we can just as well look upon G as a subset of 
[X, f]. This does not affect |\Tx\| or |T|. Now, assuming that Y is 
complete, we consider the class of all bounded functions g with domain 
G and range in Y, with ||g|| = sup \|g(T)||. This space is complete. For 


each x € Z let Ax be the function on G with value Tx at T. Then A isa 
linear operator with domain Z. It is easily proved that A is closed and 
hence continuous. The proof that G is a bounded set in [X, Y] is then 
just like the last part of the proof of Theorem 4.4-B. 

It is possible to regard Theorem 4.4-B as a special case of Theorem 
44-E. The parts of Y, Y, [X, Y], Z, and G in Theorem 4.4-E are played 
by X', A (the space of scalars), X", M and J(F) in Theorem 4.4-B. 
Saying that J(F) is bounded in X" is equivalent to saying that F is bounded 
in X (J the canonical mapping). 


$4.4] GENERAL THEOREMS ON LINEAR OPERATORS 205 


AS a particular case of Theorem 4.4-E we note the following (with 
assumptions on X and Y as in the theorem): If T, e [X, Y] and if 
Tx = lim T,x exists for each x € X, then T € [X, Y]; that is, T is not only 


linear, but also continuous. 

One of the striking applications of the principle of uniform boundedness 
is concerned with the notion of analyticity for vector-valued functions of 
a complex variable. If X is a complex Banach space and 4 is an open 
set in the complex plane, we shall say that a function f defined on 4, with 
values in X, is /ocally analytic on A if f(A) is differentiable with respect to 
the complex variable A at each point of 4. If /’(Ao) is the derivative of 
F(A) at Ao, this means that 


Je = fO) 


AC = fs) | +0 as À — Ag. 


A necessary condition for this to be true is that 


{A Aw) 


lim x =X 


A>Ag 
exist for each x’ eX’ (the limit, of course, will be x’{f’(Ao)}). The 
remarkable fact is that this, apparently weak, necessary condition is in 
fact also a sufficient condition for the local analyticity of f. 


Theorem 4.4-F. Let X be a complex Banach space, and let f be a 
function with values in X, defined on an open set A in the complex d-plane. 
Let M be a closed linear manifold in X' which is norm-determining for X. 
Suppose that, for each x' € M, x'[f(A)] is differentiable at each point of A. 
Then f is locally analytic on A. 


PROOF. Since X is complete, it will suffice to prove that for each point 
Ao in 4 the expression 


fA) = fo) — fw) — Ad) 
A — Ao p — Ao 


approaches 0 as A and p independently approach Ag. Let r > 0 be such 
that Ae A if jà — Ag| < r. Suppose 0 < |À — Aol < rand O < |u — Ag 
<r. By Cauchy’s formula we have, for each x’ € M, 


pof xCU y 
xu» = 3 [ 32590 a, 


where C is the circle |é — Ao| = r, positively oriented. Corresponding 
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formulas hold with A, and » in place of A. A straightforward calculation 
leads to the formula 


(44-4) x [£3 09 Qo) — fl) — Ko 


pes ü Ny 


1 
xi]. VO g XP -€ 34 


Now x'[/(£] is continuous, and hence bounded, on C. Therefore, by 
Theorem 4.4-B, there is some constant A4 such that || (| < 4 when £ is 
on C. If we now require that |à — Ag] < ir, |e — Ao| < 4r, so that 
JE — A| > 4r when é is on C (and likewise for p in place of A), we readily 
see that the absolute value of the left member of (4.4—4) does not exceed 
4r-2A]|x'|| |3 — uj. It follows from (4.4-1) and (4.4-3) that 


| fO) = fad) — flu) — fAo)|| . 441A — ul 
A— Ào p— X r(M) 


if 0 < |A— Aj & jr. and O« |u — Aj <4r. The desired con- 
clusion now follows. 

In order to emphasize the remarkable quality of Theorem 4.4-F, we 
point out explicitly that, if (x,) is'a sequence in X such that x'(x,) > x'(x) 
for each x’ € X', it does not necessarily follow that |x, — xj — 0. For 
example, take X = /2 and x, = (1, 0, 0, -- 9, x» = (0, 1, 0, >, 

= (0, 0, 1, 0, -+-), etc. Then x'(x,) —^0 for each x' e X'. For, we 
know by Theorem 4.32-A that x' is representable in the form x'(x) — 


> oe, with 2 le,|? < ov. Hence x'(x,) = «,— 0 = x'(0) for each 
1 1 
x’. But it is not true that |jx,|! > 0. 

There is a theorem which is related to Theorem 4.4-F in much the 


same way that Theorem 4.4—E is related to Theorem 4.4-B. 


Theorem 4.4-G. Let X and Y be complex Banach spaces, and let A 
be an open set in the complex plane. For each à in A let A, be an element 
of [X, Y]. Suppose that A,x is a locally analytic function on A, with 
values in Y, for each x in X. Then A, is a locally analytic function on A, 
with values in [ X, Y]. 


We have here an inference from differentiability in the metric of Y to 
differentiability in the metric of (X, Y]. Or, to put it another way, if 
A,x is differentiable for each x, it is differentiable uniformly for all x such 
that |x| < 1. As in Theorem 4.4-E, it is sufficient to make the 
assumption for all x in a closed subspace of X which is norm-determining 
for[X, Y]. The proof is left to the reader. 
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PROBLEMS 


I. It is essential that X be complete in Theorem 4.4-C. To show this let X 
be the subset of those x € /? for which x = {ép} and £, = 0 if k exceeds some 
integer depending on x. Let x,'(x) = n£,, and let F be the countable set of 
the elements x1’, x7, +++. 


2. a. A Banach space X is said to have a countable basis {u,}(n = 1, 2, ---) if 
oo 
each x € X can be represented in one and only one way as a series x — > WU. 
1 
Show that no u, is 0 and that {u,,/||u,||} is also a countable basis. 
oo 


b. Let W be the class of all sequences w = {wp} such that > wUz, iS con- 
| 1 


vergent. Define 


n 
2, oxur 
1 


Show that with this norm W is a Banach space. [First show that |w,| < 


iwi] = sup 


2(lwil/lu,). Now define Tw = > oun. Show that T is a linear homeo- 
1 


morphism of W onto all of X. 
c. Define ug € X' by uj(x) = wp. Show that lu," < 2IT llull. 


d. Let Y be the space of all scalar sequences y = (54) such that > wing İS 
1 


convergent whenever w = {w} e W. Define 
ie] 

> ORNK 
1 


o 
Show that Y is congruent to X’, with y x’, where x(x) = > DENK» 
n 


llyl| = sup , where x = Tw. 


lxi 1 


3. Show that a Banach space with a countable basis is separable. 

4. There is an alternative way of proving Theorem 4.4-B without using the 
closed-graph theorem. For each x € F consider |x’(x)| as a continuous, real- 
valued function of x', defined on M. Since M is complete we can apply Theorem 
2.41-D to conclude that |x’(x)| is uniformly bounded as x varies over F and x’ 
varies over some closed sphere in M. Suppose K > 0, à » 0, and that 
x| < K if xeF and lx — x9] < 9 (x' and x € M). Show that 
Py(x) < 2K/8 if x € F and hence that |ixl| < 2K/8x(M) if x € F. 

5. Let X=, 1 <p « œ. Let ($,) be a sequence of complex-valued 
functions defined on the open set 4 in the complex plane. Then f(A) = {¢,(A)} 
defines a function on A into Y which is locally analytic on 4 if and only if each 


$n is locally analytic and the series > |¢,(A)|? is convergent and bounded on 


i 
each compact subset of J. Use Theorem 4.32-A. 


208 INTRODUCTION TO FUNCTIONAL ANALYSIS  [$ 4.41 


6. Let S be a nonempty subset of the normed linear space X, and let M be 
a subspace of X’. Consider the topology Zo for X defined by the norm and 
the topology 7 (X, M) as defined in § 3.81. If S is bounded relative to 7, it is 
bounded relative to 7(X, M). Show that the converse statement is true if M 
is norm-determining for X. 

7. Let p, and p; be two norms on the linear space X, generating topologies 
J, and J, respectively. Let M; be the subspace of all x’ € X/ such that x’ is 
continuous relative to .7;(/ = 1, 2. Now 47; is stronger than 7 if and only 
if there is some C > 0 such that p,(x) < Cp;(x) for all x. Show that this is 
equivalent to having M; € Mì. Asaresult, 7, = 7 if and only if M, = M;. 

8. Let X be a locally convex topological linear T,-space, with topology 7. 
Let M be the class of all x’ € X/ which are continuous relative to. 7. Suppose 
there is in .7 a neighborhood of 0, say Yo, which we may as well assume is 
balanced and convex, which is bounded relative to 7(X, M). Then 4 is the 
topology generated by the Minkowski functional of Vo (call it po), this functional 
being in fact a norm (see problem 2, § 3.81). First observe the following: 
if p is any continuous seminorm on X, let g(x) = max {p(x), po(x)}, and let Q 
be the family of seminorms q obtained in this way. Then Q generates 7, and 
each q is a norm. Let 7, be the topology generated by the norm q, and let 
M, be the set of those x' € X/ which are continuous relative to 7,. Then 
M,C M. Asa result, Vy is bounded relative to 7, (see problem 6). It can 
then be shown that p, and q generate the same topology, which must be 7. 

9. Let M be a norm-determining linear manifold in X', with characteristic 
v 2 WM). Let S, = (x:lxl € æ}. Show that, relative to the topology 
J (X, M), the closure of S, lies in S,,,. Hence, if v = 1, S; is closed in this 
topology. For further study of (M) and Z(X, M) see Dixmier, 1. 

10. If J is the canonical mapping of X into X", J( X) is norm-determining for 
X’ and of characteristic 1. Hence (x':[Ix'|| < 1} is closed in X^ with respect 
to F(X’, J(X)). 

tl. The space X is norm reflexive if and only if the topologies 7(X’, X^) and 
J(X',J(X)) for X’ are the same. (A clue will be found in § 3.81.) 


4.41 Weak Convergence 


Suppose X is a normed linear space, and consider the weak topology 
Z (X, M) for X, as defined in § 3.81, on the supposition that M is a total 
subspace of X'. If {x,} is a sequence in X, we shall say that {x,} is 
M-weakly convergent to x (where x € X) if {x,} converges to x in the 
sense of the topology 7(Y, M). In view of the definition of F (X, M), 
this means the same as saying that x'(x,) — x'(x) for each x' e ‘M. The 
requirement that M be total makes the limit x unique, for then .Z (X, M) 
is a Hausdorff topology (Theorems 3.81-B and 3.3-G). Theorem 4.4-B 
shows that an M-weakly convergent sequence is bounded in norm if M 
is a closed subspace of X' which is norm-determining for X. 

In the case of X'-weak convergence (ie., when M = X") it is the 
common practice to drop the reference to X' and speak merely of weak 
convergence. 
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If J is the canonical mapping of X into X", then J(X) is a total subset 
of Y". We shall habitually write 7(X’, X) in place of F(X’, J(X)). 
See the remarks about duality in $ 3.81; we have here an instance of this 
kind of duality when we consider the topology 7(X, X") for X and the 
topology Z(X', X) for X'. The topology 7(X', X) is what is often 
called the w* (or weak-*) topology for X' in current literature. 

If (x,') is a sequence in X’ which is convergent to x’ (where x’ e X?) 
in the sense of the topology 7(X’, X), we say that {x,’} is X-weakly 
convergent to x’. This happens if and only if x,'(x) > x'(x) for each 
xex. When X is complete this implies that {||x,'||} is bounded [Theorem 
4.4—D(5)]. 


Theorem 4.4l-A. Jf X is separable, every bounded sequence in X' 
contains an X-weakly convergent subsequence. 


PROOF. Let {x,’} be a bounded sequence in X', and let {x,} be a 
sequence which is dense in X. Since {x„ (x;ı)} is a bounded sequence of 
scalars, it contains a bounded subsequence, which we denote by 
{Xn1'(X1)}. Likewise (x,1'(x;)) contains a convergent subsequence, which 
we denote by {x,2'(x2)}. Continuing by induction, we obtain a “diagonal 
sequence" {x,,,’} such that lim x,,/(x,) exists for each k. It is then easy to 

n> 


see that {x,,,(x)} is a Cauchy sequence for each x, thus defining x’ € X’ 
such that (x,,'] is X-weakly convergent to x’. 
If we suppose that {x,} is X'-weakly convergent to x, it follows that 
[x|| < lim inf|x,l. For, |x’(x,)| < ixi lx,]l, whence |x GO| < lix] lim inf 
nc i no 


lixa- The desired result now follows from (4.3-2). In particular, if 
xal € C, it follows that |x|] < C also. 


Theorem 4.41-B. Jf X is norm reflexive, each bounded sequence from 
X contains an. X'-weakly convergent subsequence. In particular, if (x,) is 
a sequence for which |x,| < l, it contains a subsequence converging 
X'-weakly to a limit x for which ||x|| < 1.. 


PROOF. In view of the remarks preceding the theorem, it suffices to 
prove the first assertion. Suppose x, € X and sup |x,| = C < œ. Let 
n 


Xo be the closed linear manifold generated by x;, xj, -- -. It is easy to 
see that X is separable. It is reflexive, also (Theorem 4.31-B). Hence 
Xo" is separable, and therefore Xo’ is separable (Theorem 4.3-E). The 
canonical mapping of Xo onto X," carries {x,} into a bounded sequence 
in Xj". By Theorem 4.41-A this latter sequence contains an Xy’-weakly 
convergent subsequence. This subsequence corresponds to a subsequence 
of {x,} which is Xo'-weakly convergent to a limit in Xo. Since every 
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element of X’, when restricted to Xo, determines an element of Xg’, it is 
clear that the subsequence in question is X'-weakly convergent. This 
completes the proof. 

Weak convergence is used in various contexts in the calculus of 
variations and in the general theory of differential equations. 


PROBLEMS 


|. If M is a total subspace of X’, (x,) is M-weakly convergent to x provided 
that sup ||x,|| < œ and that x'(x,) — x'(x) for each x’ e G, where G is some 
n 


dense subset of M. 

2. If {x,’} is X-weakly convergent to x’, then |!x’|| < lim inf ||x,’||. 

3. If x, = {ém} e Ip, where 1 < p « œ, {x,} is X’-weakly convergent to 
x = (£j) (where X = lP) if and only if sup EA ‘| « oo and lim & = £, foreachk. 


4. In X = l!, {x,} converges X weii to x if and only if flx, — x|| > 0 (see 
Banach 1, page 137). In spite of this, the topology 7 (X, X’) is not the same 
as the topology generated by the norm. 

5. If X = C[a, b], a sequence {x,} is X'-weakly convergent to x if and only 
if sup llix,l| < œ and x,(r) > x(t) for each ¢. The necessity of these conditions 


is evident The sufficiency is clear from standard convergence theorems as 
soon as one knows how to represent elements of X’ with the aid of a suitable 
signed measure. See § 7.7; also see Banach, 1, page 134. 


6. For X = L»(a, b), where 1 < p < œ, {x,} converges X'-weakly to x if and 
only if sup |x,|| < o» and f X,(t) dt > f x(t) dt for each measurable set E of 
n E E 


finite measure on (a, b). (Use problem 1 and the known representation of 
elements of X' in this case.) For p = 1 the result breaks down, the conditions 
being necessary but not sufficient for weak convergence. This is because the 
finite linear combinations of characteristic functions of sets of finite measure 
are not dense in L(a, b). For a further discussion see Banach 1, page 136. 


7. A space X is called X’-weakly sequentially complete if the existence of 
lim x'(x,) for each x’ € X’ implies the existence of x € X such that (x,) converges 


n—»9o0 

X'-weakly to x. The space C[a, b] is not X’-weakly sequentially complete. 
However, any norm-reflexive space is X’-weakly sequentially complete. The 
nonreflexive spaces L!(a, b) and l! are X’-weakly sequentially complete. See 
Banach 1, page 141. 


4.42 An Application of Vector-Valued Analytic Functions 


Many feátures of the classical theory of analytic functions are retained 
in the theory of analytic functions whose values lie in a complex Banach 
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space. In Chapter 5 we use the theorems of Cauchy, Liouville, and 
Laurent in this more general setting. In this section we present an 
interesting application of the theory of Banach-space-valued analytic 
functions to prove some classical theorems about mean values of complex- 
valued analytic functions. 

Analyticity of a vector-valued function may be defined in terms of 
differentiability, as in the latter part of $4.4. We may also use the 
theory of power series in a complex variable, with Banach space elements 
as coefficients. 

We begin by observing the generalization of certain standard theorems. 
Here X denotes a complex Banach space. 


Theorem 4.42-A. Suppose 4 is a connected open set in the complex 
A-plane. Let F be holomorphic (single valued and analytic) on A, with values 
in X, and suppose that |F(A)| is not constant on A. Then ||F(2)|| cannot 
attain an absolute maximum at any point of A. 


PROOF. We could imitate one of the classical proofs which uses 
Cauchy's integral formula. Instead, we shall give a proof using linear 
functionals. Suppose the theorem false, so that for some Ay € 4 we have 
F(A)! < ||F(9)|| for each A. Using Theorem 4.3-B, we choose x’ € X’ so 
that ||x’|| = 1 and x'[F(Ag)] = ||F(Ag)]. Then x’[F(A)] is a complex-valued 
holomorphic function such that |x’[F(A)]| < |x [Fo] at all points 
àc. The classical counterpart of Theorem 4.42-A then implies that 
x'[F(A)] is constant in 4, its value being |F(Ao)). But |x [F(Q)]] < IFA), 
and, since ||F(A)|| < ||F(Ao)|| at some points of 4, we have a contradiction. 

Now consider the special case in which 4 is the circular region 
{A:|A| < R}, where R > 0. Let M(r) = man FA, 0 <r < R. Theo- 


rem 4.42-A implies the following theorem. 


Theorem 4.42-B. Jf F is holomorphic when |^ < R, then M(r) is a 
nondecreasing function ofr. Furthermore, 0 < r; < r; and M(ri) = M(r2) 
imply that M(r) is constant when Q < r & rp. 


We also have the generalization of Hadamard's three-circles theorem: 


Theorem 4.42-C. If F is holomorphic and not identically 0 when 
[A] < R, then log M(r) is a convex function of log r when 0 < r < R. 


This theorem may be proved exactly as in one of the standard proofs 
for the complex-valued case (e.g., Titchmarsh 1, § 5.3 and § 5.32), except 
that norms are written instead of absolute values. 

Let us now turn to the definition of the means M%,[/; r] in (3.11-9), 
where f is a complex-valued function which is holomorphic in the unit 
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circle of the complex plane. We are going to assume that 1 < p < oo and 
prove: 


I. ML; r] is, for 0 < r < 1, a strictly increasing function of r, unless 
f is a constant. : 

2. If f is not identically 0, log 9R,[f; r] is a convex function of log r 
when 0 « r « l. 


These propositions go back to G. H. Hardy, 1. Very beautiful proofs 
of the propositions were given by F. Riesz, 3, using the principle of 
subharmonic functions. The propositions are true for all p > 0, but our 
proofs require p > 1, because we depend on the fact that H» is a Banach 
space if p > 1. See $3.11 and problem tc in § 3.13. 

If f is holomorphic when |z| < 1 and if |A| < 1, let f, be the function 
defined by f,(z) = f(Az). Then f, is holomorphic in a domain which 
includes the closed disk |z| < 1, so that f, € Hr. Hence the function F 
defined by F(A) = f, is a function of à with values in H». It is a fact of 
crucial importance for us that F is holomorphic when |A| < 1. See 
problems 1-3 for a discussion of this matter. If we compute ||F(À)]] = 
(All, using G.11-11), we find that FQ) = IEAJ. Thus FQ is 
constant on the circle |A| = r; we denote it by M(r). Theorems 4.42-B 
and 4.42-C apply to M(r) for r < 1. The computation of ||F(A)|| also 
shows that 


(4.421) M(r) = soup. ML; rx]. 


From this we shall be able to show that 
(4.42~2) M(r) = ML; r). 
First we take note of the fact that 
(4.42-3) Mf; 0] = |O] < WI; r] 


if 0 « r < l and that the inequality here is strict unless f is a constant 
function. For, by Cauchy's formula, 


IO = z- [^ rem a 


whence |/(0)| < Mt,[f; 4]. The inequality here is easily seen to be strict 
unless fis constant. But then 9t[f;r] < M,[/; r] if 1 < p (see Hardy, 
Littlewood and Polya, 1, page 143), whence (4.42-3) follows. 

Now let ¢(r) = 9X,[f;r]; we know that ¢ is continuous. Evidently 
M(0) = ¢(0) and (r) < M(r), because of (4.4271). Suppose that for 
some rg we have 0 < rg < 1 and (rọ) < M(ro). Consider the maximum 
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of d(r) forO < r < rọ. It occurs for some r; on the interval and is equal 
to M(ro), by (4.42-1). That is, ẹ(rı) = M(ro). Hence r, < ro, because 
$(rj) # é(rg9. We see that M(rg) < M(ri). But M(rj) < M(ro), by the 
first conclusion in Theorem 4.42-B. Hence M(r,) = M(ro), and it follows 
from the second conclusion in Theorem 4.42-B that M(r) is constant on 
[0, ro]. Then (ro) < M(ro) = M(0) = 4&0). This contradicts (4.42-3). 
Hence (4.42-2) is established. 

Proposition 2 now follows at once from (4.42) and Theorem 4.42-C. 
From Theorem 4.42-B we infer that 3X,[f; r] is a nondecreasing function 
of r. Actually, M [f; r] must be strictly increasing, unless f is constant, 
for otherwise, by Theorem 4.42-B we would have M(r) constant on some 
interval [0, rj], whence ®,[f;0] = 9X, [/; ri] in contradiction to the 
statement made in connection with (4.42-3). 


PROBLEMS 


l. Let u(z) = zz, n = 0, 1, ++». Show that u,, as an element of Hr, has 
luu] = 1. 


2. If h e HP and h(z) = b: c,z", use Cauchy's formulas for c, to show that 
0 


r'lc,| < M,[h; r] if 0 « r « 1, and hence |c,| < ||A||. Deduce that |h(z)| < 
ALC — |z[)7t if fz] < 1. 


oo 
3. If f(z) = > a,z" converges when |z| < 1, show that b a,A"u, is convergent 
0 0 


to f, in the metric of H? (with u, as in problem 1). First show that the series 
converges to some element g € Hr. Then use problem 2 to show that 


2 a,A"z" = g(z), whence g = f;. The conclusion is that F(A) is given by a 
0 


power series in A with coefficients from H?. Hence F is holomorphic. For 
this and more general results of the same type see Taylor 3, 4. 


4.5 The Conjugate of a Bounded Linear Operator 


The notion of the conjugate of a bounded linear operator is closely 
related to the notion of the transpose of a linear operator, as defined 
in § 1.8. 

Let, X and Y be normed linear spaces, and suppose Ae[X, Y]. If 
y' € X', the linear functional x’ defined on X by x'(x) = y'(Ax) is clearly 
continuous. We write x' = A'y'. The operator A’, which is linear and 
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maps Y' into X’, is called the conjugate of A. The definition of A’ is 
expressed by the formula 


(4.5-1) x, A'y’> = <Ax, y), xeX,yeY. 


If Y’ = Yf (which is the case if Y is finite dimensional), A’ is the same 
thing as the transpose AT. However, Y' is a proper subspace of Y/ in 
general, so 47 is an extension of A’, or A’ is the restriction of 47 to the 
space Y'. 

If A'y' = x’, we have |x'G)| = |»'X45)| < lly'll Axil < [yi LAT ix, 
and so ||x’|| < [All ||y']. This shows that A’ is continuous on Y' and that 
||A’|| < |All. On the other hand, 


[»'(A23)] = |x'€9| « [IT] lxi = n4" v^ x. 
Hence, by (4.3-2) and the definition of ||A’, 
|Ax|| = un |» (Ax)| < SUP. IA y^ ll lll] = A'I xr. 


Therefore ||4|| < ||A’\|. We have thus proved the formula 
(4.5-2) [LAT = LATI. 


Other notations and terminologies have been used for A’. It has been 
denoted by 4 or A*; it has been called the adjoint of A and also the dual 
of A. In this book the notation A* and the name “‘adjoint”’ are reserved 
for use in connection with linear operators in Hilbert space. In that 
situation A* is closely related to A’, but is not the same as A’. It is 
troublesome to have A* mean one thing when we deal with Hilbert space 
and another thing in the general theory of normed linear spaces. Hence 
our distinction between A* and A’. 

We sometimes need some formal algebraic rules for handling conjugate 
operators. If A and B are in [X, Y], then 


(4.5-3) (A+B) 2 A' +B and (aA) = aed’. 
If B € (X, Y] and 4 € [Y, Z], then 
(4.5-4) (ABY = B'A'. 


If A e [X, Y] and if A~! exists and belongs to [Y, X], then (4^)-! exists, 
belongs to [X’, Y'], and is the same as (4-1). We leave it for the reader 
to verify these assertions. 

If we are studying the operator A, a knowledge of certain facts about 
A’ can be helpful to us. In general A’ is more amenable to investigation 
than AT. In studying A’ we usually need representation theorems for 
elements of Y' and X' (as in § 4.32, for example). We also need 
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representation theorems for bounded linear operators. For instance, 
suppose X = Y = Į, where 1 « p « oco. We know from Theorem 
4.32-A that X' is congruent in a natural way to /". In the problems at 
the end of 8 4.51 we shall see that, if A € [/?], A can be represented by an 
infinite matrix and that A’, which we identify with an element of [/»'], is 
representable by the transposed matrix. Likewise, if X = Y = L2(a, b) 
and if K is the Fredholm-type operator defined as y = Kx by 


‘ b 
y(s) =° Í: k(s, x(t) dt, 


where k is an Y2 kernel (see § 4.12), we can identify X’ with L?(a, b) and 
K' with the Fredholm-type operator determined by the transpose kernel 
k'(s, f) = k(t, s). This identification is a consequence of the general 
representation theorem for linear functionals on a Hilbert space (see 
§ 4.81). 


PROBLEMS 


l. Suppose Y and Y are normed linear spaces, and let A be a linear operator 
with domain X and range in Y. Suppose that Y' contains a closed linear 
manifold M which is norm-determining for Y and such that AT(M) € X’. 
Then A is continuous. Apply Theorem 4.4-B to the set {Ax:||x|]| < 1} in Y. 


2. If A maps X congruently onto all of Y, then A’ maps Y' congruently onto 
all of X’. 

3. Suppose 4 e[X;, X2]. Then (4Y = A” e[X,", X7]. Let J, and J, be 
the operators defining the canonical mappings of X, and X; into X," and X,” 
respectively. Then A'"J, = J;4. If we identify X, with J,(X;) and X, with 
J2(X5), this means that A” is an extension of A. In particular, A” coincides 
with A if X, is norm reflexive. 


4. If X, is norm reflexive and Y, is congruent to Xz, then Xz also is norm 
reflexive. 


4.5{ Some Representations of Bounded Linear Operators 


In this section we discuss the representation of bounded linear operators 
on X into Y, especially for the case in which X and Y are chosen in various 
ways from the spaces /?, (c) and (co). The discussion is based on a 
theorem of very general scope about the representation of linear operators. 

For the purpose of our first general theorem we make the following 
assumptions: X is an arbitrary Banach space; Z is an arbitrary normed 
linear space; S is an arbitrary nonempty set of elements of unspecified 
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nature; Y is a Banach space which is a subspace of the linear space of all 
functions defined on S, with values in Z. If se S and y € Y, we call 
y(s) the component of y at s, and we assume that y(s) is a continuous 
function of y. A possible choice for Y is P (1 < p < oo), with S the set 
of positive integers and Z the space of scalars. Again, the space B(S) 
of bounded scalar-valued functions on S, for an arbitrary S, is a possible 
choice for Y. 

In what follows we refer to the space [X, Z]. This is X' if Z happens 
to be the space of scalars; it is this choice of Z that we shall use mainly 
in the applications of these general considerations. 


Theorem 4.5I-A. Assume X, Y, Z, S as in the foregoing remarks. 
Then, to each A € [X, Y] there corresponds a function on S to [X, Z], 
whose value at s we denote by a(s), such that, if y = Ax then y(s) = a(s)x 
for each s. Conversely, if a(-) is any function with domain S and range 
in (X, Z] such that for each x EX the formula y(s) = a(s)x defines an 
element of Y, this dependence of y on x defines an element A of [X, Y]. 


PROOF. IfA c [X, Y]isgivenand y = Ax, we define a(s) bya(s)x = y(s). 
Then a(s) e [X, Z] for each s. The linearity of a(s) is evident, and the 
continuity of a(s)x with respect to x follows from the fact that y(s) is a 
continuous function of y. For the converse part of the proof, the linearity 
of A is evident, and its continuity will follow from Theorem 4.2-I if we 
prove that 4 is closed. Suppose that x,— x. Then a(s)x, — a(s)x, 
because a(s) € [X, Z]. Suppose also that Ax, — y. Then (Ax,)(s) — y(s) 
for each s, by the continuous dependence of components on vectors. 
But (Ax,)(s) = a(s)x,. . Hence a(s)x = y(s), so that y = Ax; that is, 
A is closed. 

A situation of some especial interest is that in which the space Y is of 
such a nature that the norm of an element in Y is given by 


(4.51-1) ME sup l»€s)llz- 


Here ||y(s)||z denotes the norm of y(s) as an element of Z, s being fixed. 
Among the examples of spaces Y of this type, all with Z the space of 
scalars, we cite /”, (c), (cg), B(S), and, if S is a topological space, the 
subspace C(S) of B(S). 


Theorem 4.51-B. With the hypotheses as in Theorem 4.51-A, suppose 
the norm in Y is given by (4.51-1). Then a(-) is a bounded function on S 
to [X, Z], and 


(4.51-2) |All = sup llaCs)Il. 


$4.5]] GENERAL THEOREMS ON LINEAR OPERATORS 217 


If Z is complete and if Y consists of all bounded functions on S to Z, any 
bounded function a(-) on S to (X, Z] determines an operator belonging to 
[X, Y]. 

The proof is left to the reader. The assumption in the last part, that 
Z is complete, is made to insure that Y is complete, this being needed in 
Theorem 4.51-A. 

Let us denote by BzZ(S) the Banach space of all bounded functions on 
S to the Banach space Z, with norm as in (4.51-1). Using this notation 
for arbitrary Z, we see that Theorem 5.51-B implies that [.Y, Bz(S)] is 
congruent to Bry, z;(S) in a natural way. If Y is a closed subspace of 
Bz(S), the theorem states that [X, Y] is congruent to a subspace of 
Bix, zi (S), but the theorem does not describe this subspace. A certain 
description of the subspace may be inferred from Theorem 4.51-A. 

We can now give representation theorems for elements of [X, Y], 
where X is one of the spaces (co), (c), or (1 < p < oo) and Y is one of the 
spaces /^, (c), or (co). For this purpose we need Theorem 4.32-A and 
the results stated in problems 1 and 2 at the end of $84.32. We take Z 
as the space of scalars and S as the set of positive integers. 


Theorem 4.51-C. Each bounded linear operator A on (co) into IP, 
(c), or (co) determines and is determined by an infinite matrix of scalars 
«i,j = 1,2,-+-), y = Ax being expressed by the equations 


(4.51-3) m= > ah i=l. 
The norm of A is given by 


(4.51-4) |All = sup > layl- 
t j=l 


For the case of mapping into l^ the only restriction on the matrix (œ;;) is 
that the expression defining ||A|| be finite. For the case of mapping into (c) 
the only additional requirement is that the limits 

(4.51-5) aj = lim Qij j = 1,2, 

must exist. Finally, the mapping is into (cọ) if and only if, in addition, 
ay = a2 E — 0 


PROOF. For the case of mapping into /^, the theorem results immediately 
from problem 2, § 4.32, and Theorems 4.51—A, 4.51-B. For the case of 
mapping into (c) the further requirement is that lim y; exist for each 


choice of x in (4.51-3). An obvious special choice of x shows the 
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necessity for the existence of the limits in (4.51-5). On the other hand, if 
these limits exist, it is easy to prove that 


(4.51-6) lim y; = > e, 


i—o 4 


j=l 


For, we know that > le;| < ||Al| for alli and m. Letting first i and then 
j=1 oo 


n become infinite we see that bi le;| < l4]. Then, for each n, 


j=l 
T — » «j£; > (ai; — 23 
1 j=1 


< 


>, ley — «jl l6 + 2141 sup [6j]. 
Ti J>n 


From this it follows that (4.51-6) is true, so that y € (c) if x € (co). We 
leave to the reader the proof of the last assertion in the theorem. 

The next theorem concerns operators 4 € [(c), Y], where Y is either /, 
(c) or (co). It is slightly different from the foregoing theorem, because 
of the intervention of the limit é = lim £j when x = (£j) € (c). 

jo : 


Theorem 4.51-D. Each bounded linear operator A on (c) into I™, (c); 


or (co) determines and is determined by a matrix of scalars a; (i = 1, 2, +», 
j=0,1,2,---) y= Ax being expressed by the equations 


(4.51-7) phe > uf, i212, 
j-0 
The norm of A is given by 
(4.51-8) |All = sup > [ai]. 
PF I0 


For A € [(c), I] the sole condition on the matrix («;;) is that the expression 
defining ||A|| be finite. For A € [(c), (c)] there is the additional requirement 
that the limit 


(4.51-9) « = lim > e; 


i— 


- 
i 
e 


exist and that the limits 


(4.51-10) a; = lim o; 
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exist ifj = 1, 2,-+- (no requirement when j = 0). Finally, the range of A 
is in (co) if and only if, in addition, « = 0 and œ; =a, =.. =Q. 


Proof is left to the reader, who should refer to problem 1, § 4.32. 
We note, incidentally, that, if A € [(c), (c)] and lim n; = xo, then 


(4.51-11) no = Éa + Se — £gay- 

j=l 
For, from problem 1, § 4.32 we have 

Ax = Aug + 5 (£j — &)Au;. 
j=l 
If uo’ is the continuous linear functional defined by uo'(x) = £o, we have 
ug (Ax) = ouo (Aug) + S (£j = £o)ug (4u;), 
j=l 


and a little checking shows that this result is equivalent to (4.51-11). 
We see from (4.51-11) that no = & for every choice of x if and only if 
a=landa =a,=---=0. 

When X and Y both are spaces with a countable basis, they may be 
regarded as spaces whose elements are sequences. This latter is then true 
of the conjugate spaces X', Y'. (For basic facts about X and X' when 
X has a countable basis see problem 2, § 4.4.) In such cases an element 
A€[X, Y] is representable by an infinite matrix, and the conjugate 
operator A’ is then representable by the transpose of this matrix. For 
more precise details see problem 6. 


PROBLEMS 


l. Each bounded linear operator A on /? (1 < p < œ) into /®, (c), or (co) is 
representable by an infinite matrix (o;;) of scalars, where y = Ax is expressed 
by equations (4.51-3). The norm of A is 


eo 1/p" 
sup ( > le ifl<p<o 
lA) = 4 $ v 
sup sup læ] if p = 1. 
i J 


Except for the difference in the expression for ||All, the rest of the assertion here 
is just like that in Theorem 4.51-C. 
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2. A matrix (o;j) (i, j = 1, 2, - - -) defines a bounded linear operator A on /? 
into /©, by means of equations (4.51-3) if the following expression, which then 
defines the norm of A, is finite: 


lll = sup > loy]. 
i j= 


This is not, however, the most general form for an element of [/™, /©], for 
elements of (/9)' are not all expressible by an infinite series. The operator has 
its range in (c) or co) (subspaces of /©) under the same conditions for these 
things as are stated in Theorem 4.51-C. : 

3. If X is any Banach space, the general form of A € LX, l4], where 1 € q < ©, 
is y = Ax, where y = (nj) and n; = xi'(x), (xj/) being a sequence of elements 
of X’ such that (x;'(x)) e /¢ for each x. 

4. Suppose X — [^ (1 « p< o) in problem 3. The form of x,’ is 


oo 
x(x) = > a,;€;, where 
j=l 


co 1/p’ p 
lq] = (> li) O t 


No direct condition on the matrix elements «;; have been discovered which are 
necessary and sufficient for the matrix to yield an operator A in [/», /?]. Nor is 
there any known explicit representation of ||4|| as a function of the matrix 
elements. For p — 1 see problem 5. 


5. Each bounded linear operator A on l! into /7 (1 < q < ©) is representable 
as in (4.51-3) by a matrix («;j). The only condition on the matrix is that the 
following expression, defining |{Al|, be finite. 


E: 1/ 
All = sup (> ui^) . 
J 


i=1 


Conversely, any matrix satisfying this condition determines an A in {/1, /4]. 


6. Let X and Y be Banach spaces with countable bases (u,) and {v,} respect- 
ively (n = 1, 2, ---). See problem 2, $4.4. Let {u,’} and {v,’} be the 
corresponding sequences of coefficient functionals, so that 


£u; uj'(x) = £j, xeX 


wo S= ver. 


By the problem referred to, elements of X' and Y' are representable in the 


- respective forms 


x(x) = DE yo) = 2, mine 
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Suppose A € [X, Y], oj; = vj/(Auj), so that y = Ax is expressed by 


qi = 2 ajé; i= | By ee 


Note that this result means that, if A is represented by a certain infinite matrix, 
A’ is represented by the transposed matrix. 


7. Suppose A € [(0), (c)] is defined by (4.51-7). Let 


oo 
ao = €* — $o 
j=1 


Ao = 05, j2b2,::5 


where « and o; are defined by (4.51-9) and (4.51-10). If x’ and y’ are elements 
of (c)' defined by 
oo oo 
x(x) = > Aé, Y= > uni, 
j=0 i=0 


show that Ay’ = x’ means 


oo 
A; EE 2, ttl j= 0, 1, 2, 95 
i- 


4.52 The M. Riesz Convexity Theorem 


Consider a matrix («;;) of complex numbers, not all 0, with m rows and 
n columns. Let £, <., é, and £4, ---, Cm be complex numbers, and let 
x= (É, Veg é) z= (5i, Uds D); If u 2 0, define 


n u 
(Sie) ifu > 0 
M(x) = 4-21 
sup |é;| ifu — O0. 
J 
If v > 0, define N,(z) in a similar manner. Let 
(4.52-1) M(p, v) = sup jb iE; > 
i=l j=l 


the supremum being taken for all x and z such that M,(x) < 1 and 
Nz) < l. Then log M(u, v) is a convex function of the point (p, v) in the 
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part of the (u, v)-plane defined by the inequalities u > 0, v 20. This 
means that if (uj, vı) and (p2, v2) are admissible points, 


log M[(1 — Du; + tuz, (Y — Dv; + tv2] 


is a convex function of t when 0 < ¢ < I. 

We shall refer to this result as the M. Riesz convexity theorem. 
M. Riesz's proof of this theorem was given in his paper 1, subject to the 
more restrictive conditions 0 < p < l,Oxv«l,u-c-vz]. See also 
Hardy, Littlewood and Polya, 1, pages 214-219. In the more general 
form the result is due to Thorin, 1. If the matrix elements o;; are real 
and if the vectors x, z are assumed to have real components, the convexity 
property of log M(u, v) obtains when 0 < p, O < v, and p+ vèl. 
This was shown partly by Riesz and partly by Thorin. 

We shall not prove the Riesz convexity theorem. Our concern is to 
discuss the application of it to continuous linear mappings of /? into A. 
For a more far-reaching discussion of the development of such ideas, with 
various important applications to integrals, Fourier coefficients, and other 
topics, see Dunford and Schwartz, 1, $810, 11 in Chapter VI, and 
Zygmund, 1, Chapter XI, especially pages 189—202. 

Suppose 1 € p < o», 1 <q < oo, and consider the m by n matrix 
(«;;) as representing a linear operator 4 mapping /«(n) into /«(m), with 
y = Ax meaning x = (£i, Crt £9. y = 90575508). and 

io ajé j 
j=l 
With the aid of Theorem 4.3-B we see that ||A|| = sup | y'(4x)|, the 
supremum being taken for all xe P(n) with |x| € 1 and all linear 
functionals y' on A(m) with ||y'| < 1. Since y'(y) has a representation 


YO) = S Emis 
i-i 


we see that 
m n 
(4.522) Al) = sup > WEAR 
i=1 j=1 
the supremum being taken for all x such that ||x|| < 1 and all (£j, © +, Em) 


determining a functional y' with |y'| < 1. Now, the normed conjugate 
of /(m) is congruent to /*(m). Hence, comparing (4.52-1) and (4.52-2), 
we see that 


|All = M(1/p, lq^). 
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where l/p is understood to be 0 if p = œ, and likewise for l/g'. To 
emphasize the dependence of |!A|| on p and q we shall write it as ||A|,. ,. 

It is clear that, when v < 1, convexity as a function of (u, v) is the 
same as convexity as a function of (u, 1 — v). Hence, by Riesz's theorem, 
log ||Allp, a is convex as a function of (1/p, 1/q). In the complex case this 
istrueforp > 1,q > 1. Inthe real case there is the additional restriction 
(1/p) + (1/q') 2 1, which is the same as q > p. We summarize: 


Theorem 4.52-A. Jf A e [/e(n), h(m)], then log ||Al|,, a is @ convex 
function of (1/p, l/q) for all p 2 1, q 2 1 in the complex case and for 
q > p = Lin the real case. 

In order to display more directly the implication of this theorem, 
suppose /(f) is a positive function such that log j(r) is convex when 
Oxt«l In particular, when 0 < f < 1, the point (¢, log (r)) on the 
graph of log ¥(t) is on or below the straight line joining the points 
(0, log #(0)) and (1, log &(1)). When the condition for this is worked 
out, it is found to be 


(4.523) Ht) « DO) “CDF. 


Suppose now that we are given pairs (p1, q1), (P2, q2) which are admissible 
under the conditions stated in Theorem 4.52-A. Let p and q be defined 
in terms of ¢ by 


(4.524) pU. fel v Octz« I. 


Let 4(?) = 4i, ,. Then (4.52-3) becomes 


(4.52-5) Allg < (Alloy, ap? “UIAllps, a) 


As t varies from 0 to 1, p varies from p, to p»; likewise for q. Formula 
(4.52-5) expresses the content of Theorem 4.52-A. For example, if 
Pi = 1,41 = 2, p; = 2, qa = co, we find that 


2 . 2». 


poc. 
In this case (4.52-5) becomes 
All, 252-9 < (Alli, DEPPA, o»)? P-P. 


Here p may vary from 1 to 2. 

Now let us consider an infinite matrix («;;), i, j = 1, 2, ---. Let Am 
be the mapping of /7(n) into /«(m) defined by considering o;; for 1 < i < n, 
Ixjsm. Itiseasily proved that the infinite matrix defines a continuous 
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linear mapping A of /? into / if and only if ||A,, mllp, ¢ is bounded as m 
and n vary and that, when such is the case, 


(4.52-6) |All, q 7 sup lAn, mllp, g 


We write ||Allp, , rather than |jA||, because we now wish to consider the 
possibility that A may be regarded as belonging to [/?, l4] for various values 
of p and q. 


Theorem 4.52-B. Suppose that («;;) is an infinite matrix of scalars. 
Let (pi, q1) and (p2,q2) be admissible pairs according to the conditions of 
Theorem 4.52-A. Suppose the matrix defines an A belonging both to 
Hn, 11] and to [lra, 192]. Then A belongs to [Ir, 19} for each (p,q) given by 
(4.524), and the norms in these various cases satisfy the inequality (4.52—5). 


The proof is immediate, by applying (4.52-5) to A, m and taking note 
of the assertion made in connection with (4.52-6). 


PROBLEMS 


l. If the infinite matrix (o;;) defines an operator A e [/?], denote its norm by 
|All Show that, if the operator defined by the matrix belongs to [/!] and 
[/*], it belongs to /? for 1 < p < co, and ||Allp < (lA1l;) »(I41,;)!- 0/2. For a 
different approach to the case p — 2, see $ 6.12. 


2. Carry out the proof of (4.52-6). 


4.6 Annihilators, Ranges, and Null Manifolds 


We are now ready to take up the study of matters corresponding to 
the subject matter of §§ 1.9, 1.91, but with X’, Y’ replacing X^, YS and 
A’ replacing AT. The differences are due mainly to the intervention of 
topological matters: the continuity of functionals and operators, and the 
distinction between closed and arbitrary linear manifolds. 

The spaces X and Y referred to in this section are understood, without 
further mention, to be normed linear spaces. Completeness is not 
needed except in some of the problems. Many of the ideas and results 
apply to general topological linear spaces and especially to locally convex 
ones, but we shall not concern ourselves with the greater generality of 
such spaces. 

In this section, and in applications based on it, the definitions of 
annihilators are as follows: If G € X, the annihilator of G in X’ is the set 


G? = {x EX':x'(x) = 0 if x eG}. 
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If H — X', the annihilator of H in X is the set 


9H = (x eX :x'(x) 20 if x’ eH}. 


It is assumed that G and H are nonempty. 

The annihilator G° is a closed linear manifold in X'; it coincides with 
M°, where M is the closed linear manifold generated by G. Similar 
remarks apply to 9H. 

In certain proofs in §§ 1.9, 1.91 we used Theorems 1.71-B and 1.71-C. 
For present purposes, in the corresponding circumstances, we can appeal 
to Theorems 4.3-D and 4.3-C. For later use we state the following 
theorems, leaving the proofs to the reader. 


Theorem 4.6-A. Jf G c X and M is the closed linear manifold in X 
generated by G, then (G9) = M. In particular, (M9) = M if M is any 
closed linear manifold in X. 


Theorem 4.6-B. If H c X' and N is the closed linear manifold in X' 
generated by H, then N c (0H). In particular, N C (0N)? if N is any 
closed linear manifold in X'. 


A linear manifold N in X’ will be called saturated if N = (9N)9. Such 
an N is necessarily closed. But a closed linear manifold is not necessarily 
saturated. To see this we refer to problem 1, § 4.32 and to the example 
at the end of 81.9. If X = (c), every x’ € X’ is representable in the form 


oo 


x'(x) = > Op eke with >. le] < oo. 
1 


0 


The space (c)' is congruent in a natural way to /'. Now let N be the set 
of those x' for which «, — 0. This is a proper closed subspace of X'. 
But °N = (0) (argument given in § 1.9) and hence (9N)? = X’. Thus N 
is not saturated. 

In the case of any X there do exist saturated subspaces of X'; (0) and 
X' are examples. So is H9, where H is any nonempty set in X. 

In view of Theorem 4.6-B we note that, if N is any linear manifold in 
X’, it is saturated if and only if (N)? c N. This is equivalent to 


complement of N € complement of (9N)9. 


Hence, a proper subspace N of X' is saturated if and only if to each 
x' € XY' — N corresponds an x €?N for which x'(x) #0. Thus, a 
saturated subspace of X’ is what has been called a regularly closed sub- 
space (see Banach, 1, pages 115-117). The notion of a saturated subspace 
is closely related to the weak topology -Z(X', X) for X' [Z(X', X) is 
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defined in the second paragraph after Theorem 3.81—B]. In fact, as we 
show later, in § 4.62, a subspace N of X' is saturated if and only if it is 
closed in the weak topology .Z (X', X). 

We now turn to an examination of theorems analogous to those of 
$1.91. When A is a continuous linear operator, the null manifold (A) 
is a closed subspace; it is closed because it is the inverse image, by 4, 
of a closed set. However, the range of A need not be closed. 


Example. Let X = Y = [!, and define A €[X] by Ax = y, where 
y = {nx}, x = (&Y and ng = klé, Clearly (A) contains all y's for 
which ną = 0 except for a finite number of indices k, and so RA) = X. 
But Z(4) # X ; for instance, the vector y with ną = k~? is in X — AA), 
because é = k-! does not define an element of X. It follows that 
&(A) is not closed. 

In the theorems which correspond to those of $1.91, it is the closure of 
the range of an operator which takes the place of the range itself. This 
is because of two things: (1) an annihilator is always closed, and (2) a 
linear manifold and its closure possess the same annihilator. 

For later reference we state the following three theorems, leaving the 
proofs to the reader. It is assumed that 4 € [X, Y]; X and Y need not 
be complete. f 


Theorem 4.6-C. (2(A4))? = (A^). 
Theorem 4.6-D. A(A) = {NA} 
Theorem 4.6-E. J(A) = Y if and only if (A') ! exists. 


At this point we are saying nothing about the continuity of (4) 1. In 
§ 4.7 we have some deeper theorems which relate the situation @(A) = Y 
to the existence and continuity of (A’)-1. These deeper theorems involve 
the issue of completeness. 

When we exchange the roles of A and A’ we do not get quite as much 
information as in the foregoing set of theorems. The following results 
are easily proved, and we leave proofs to the reader. 


Theorem 4.6-F. AA} = .W(A). 

Theorem 4.6-G. (A^) c {N (AJY. 

Theorem 4.6-H. If Z(A'") = X', then A~ exists. 
Theorem 4.6-l. If A-! exists, then (9(2(A")))? = X'. 


In connection with Theorem 4.6-G we observe that, if Z/(A4") is saturated 
in X', we have the equality #(A’) = (./(4))9. This happens, for 
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instance, if X is norm reflexive or if RA) is finite dimensional (see 
problems 1, 2 at the end of this section). Likewise, when 47! exists and 
we have reason to know that AA’) is saturated, we can conclude from 
Theorem 4.6-I that Z(4") = X”. 


PROBLEMS 


l. If X is norm reflexive, every closed subspace of X" is saturated. 

2. A finite-dimensional subspace of X' is saturated (see Theorem 3.5-C). 

3. If (o,) is a sequence of scalars with sup |«,| < œ, let X = /!, and let A 
n 


be the operator Ae[/!] defined by Ax = y, where 7», = akk. Then 
|All = sup |a,|. The inverse 47! exists if and only if «, # 0 for every n, and 


then Z(4) = X. Show that #(A) = X and 4^! is continuous if and only if 
inf |o,| > 0. 


4. If X is complete and X’ is norm reflexive, so is X. Let Jy and J; be the 
canonical mappings of X and X' into X” and X", respectively. Show that 
(J))! = Jo’, as a result of the reflexivity of X’. Then use Theorem 4.6~E. 

5. Let M be a closed subspace of the normed linear space X. Let F = X/M 
(normed as in $3.14). Then F’ is congruent to M?. The congruence is 
established by the mapping Tf = x’, where fe F' and x(x) = Klx), x e X, 
x eX’, [x] e X/M. It is to be shown that T is linear and isometric, with 
range M°. 

6. Suppose M is a closed subspace of the norm-reflexive space X. Then 
the quotient space X/M is norm reflexive. The argument is that X’ is norm 
reflexive and hence also, in turn, M9, (X/M)', and X/M. See the two preceding 
problems and problem 4, § 4.5. 

7. Suppose that X is complete and that #(A), as a normed linear space on its 
own account, is complete [as it is, for example, if Y is complete and #(A) is 
closed]. Then &(A’) = {4 (4)}}. In view of Theorem 4.6-G it suffices to 
show that (/(4))9 C 2(A4^. If x’ e (^ (4))? and y € AA), then x'(x) has the 
same value for each x such that y = Ax. Hence define f(y) = x'(x), using such 
an x. Use Theorem 4.2-G(5) to show that fe (Z(4)). Then extend f to 
obtain y’ e Y’ and show that 4’y’ = x’. 


4.61 Weak Compactness in Normed Linear Spaces 


The use of weak topologies sheds light on various questions which arise 
in relation to normed linear spaces. In this section we consider compact- 
ness, using weak topologies. 

Throughout the section X denotes a normed linear space, X' its normed 
conjugate, and J the canonical mapping of X into X". We shall be 
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concerned with the topology 7 (X, X^) for X and the topology 7 (X', X) 
for X’ (see the third paragraph of § 4.41). We also consider the topology 
F(X", X’) for X”. 

The first main result is the following: 


Theorem 4.6I-AÀ. Suppose S C X’. Let S be bounded with respect to 
the norm in X' and closed with respect to F(X’, X). Then S is compact 
with respect to Z (X', X). In particular, (x':||x'|| < 1} is compact in this 
sense. 


PROOF. Suppose C = sup ||x’||. For each xex% let A, = {«: |æ] < 
xeS 


Cixi}. Let A = ii A, (the Cartesian product as in § 2.5). Then A is 
xEX 

compact, by Theorem 2.5-A. Now, any element x' € S is determined by 
the set of values x'(x), x € X ; since |x'(x)| < lix] |xl| < Clixl|, we see that 
x eAor S c A. Moreover, it is easily verified that the topology induced 
on S by 7(X’, X) is the same as the topology induced on S by the 
Cartesian product topology for A. Hence, for the first assertion in the 
theorem, it suffices to prove that S is closed as a subset of A (see Theorem 
2.2-B). Suppose fis an element of the closure of S in A. Consider any 
e» Oandanyx,y €X. The set of all g € A such that 


igo) — fel «e o — fl « e 


and 
[gx - ») — fx -»l e, 


is a neighborhood of f in 4. This neighborhood contains some point 
X' € S, and, since x' is linear, we have 


[f(x + y) — fe) — FO) < Lf  ») — x'G  ») 
+ [x 69) — fe9| + |x'G) — £0) « 3e 


whence it follows that f(x + y) = f(x) + f(y). In a similar way we 
prove that /(Bx) = Bf(x). Now, by the fact that fe A, we know that 
f(x) € A, or | fœ] < Clxj. Hencefe X'. Then fe S, for S is closed in 
X' relative to .Z(X', X). This proves that S is closed in A and hence 
that S is compact relative to 7(X’, X). The last assertion of the theorem 
follows from the fact that (x':|x'| < 1} is closed in X’ relative to 
J (X', X) (see problems 9 and 10 in § 4.4). 

The next main result is Theorem 4.61—C, for the proof of which we need 
the following lemma: 


Lemma 4.61-B. Consider S c X and S" c X" defined as follows: 
S-—ixixi| «1, S'-ix':x!s1l. 
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Also consider the canonical image J(S) of S in X". This set J(S) is dense 
in S" with respect to the topology Z (X", X"). 


PROOF. Suppose xo” € S”, and suppose e > 0, x1, --, x, eX'. We 
shall produce an xo € S such that Jxo is in the neighborhood of xo” 
defined by e, x1’, +++, x,. That is, xo will be such that 
(4.61-1) |x; (x0) = xo (x,^)| < €, i= l; enh 


Let M be the set of all x € X such that x;'(x) = O ifi = 1,---, n. Then 
M is a subspace of Y, closed in the norm topology. By Theorem 3.5-C, 
M? is the subspace of X’ generated by xj', «++, x,' (it suffices to work 
with a maximal linearly independent subset of x;', ---, x,). Consider 
the quotient space ¥/M. The fact that the dimension of M? does not 
exceed n implies the same property for X/M. In fact, (X/M)' is con- 
gruent to M? (problem 5, § 4.6), so that (X/M)', and so also X/M, have 
the same finite dimension as M°. Now, the space X/M, being finite 
dimensional, is reflexive. We utilize the congruence of (X/M)' and M? 
under the mapping x’ = T(V’), where V'e(X/M), x' e M9, and 
x'(x) = V'([x]. Using the given xo” € S", we define V^ e(X/M)' by 
V'(V') = xy(TV'). Evidently |V"|| € 1, because T is norm-preserving. 
Because of the reflexivity of X/M there exists Ve X/M such that 
V'(V') = V(V) for every V', and ||Vi| = |V” < 1. Now choose 
C > sup|x;']. By the definition of norms in X/M, there exists X € V 

t 


such that |x| < ||V|| + e/C < 1 + («/C). By the definition of T, 
x'(x) = V'(V) where x' = TV’. Therefore x'(x) = xQ'(x') for every 
x' € M9, Now let xg = Cx/(C + e) We see that ||xj| <1 and 
lx — xoll = ellxll/(C + e) < e/C. Also,ifx' € M, 


|xo"(x') — x'(xg)] = [x'() — x'Gx9) « Ix'li lix — xoll < elix'll/C ; 


therefore, by the definition of C, it follows that (4.61-1) holds. This 
proves the theorem. 

We observe that, if X is given the topology 7 (X, X") and the canonical 
image J(X) of X in Y" is given the topology induced on it by Z(X", X’), 
then J is a linear homeomorphism of X onto J(X). This is clear directly 
from the way in which the bases at 0 are defined for the topologies in 
question. 


Theorem 4.61-C. The normed linear space X is norm reflexive if and 
only if the set S = (x:|x|| < 1} is compact with respect to the weak topology 
F(X, X’). 


PROOF. If S is compact, J(S) is compact relative to the topology 
JZ (X", X^), since J is continuous, as noted above. Hence, by Theorem 


230 INTRODUCTION TO FUNCTIONAL ANALYSIS [§ 4.61 


2.3-B, J(S) is closed in X". It then follows from Lemma 4.61-B that 
J(S) = S", for S" is closed with respect to .Z(X", X^) (see problem 10, 
$4.4. It now follows easily that J(. X) = X", so that X is norm reflexive. 

On the other hand, if X is norm reflexive, J-1($") = S. Now S" is 
compact relative to 7(X”, X’) (Theorem 4.61—A), and hence S is compact 
relative to Z (X, X"), since J-! is continuous. 

Tn the older literature dealing with Banach spaces, before the systematic 
development of the weak topologies, a good deal of attention was paid to 
the concept of weak convergence of sequences, even though the weak 
topologies themselves were not investigated. In particular, the following 
concept was used (though with different terminology): 


Definition. In the normed linear space X, a set S is called condition- 
ally sequentially X'-weakly compact if every sequence from S contains a 
subsequence which is X'-weakly convergent to some limit in X. 


We see from Theorem 4.41--B that if X is norm reflexive, every bounded 
set in X is conditionally sequentially Y’-weakly compact. -This proposition 
has a valid converse, as follows: 


Theorem 4.61-D. Jf X is a Banach space such that every bounded 
sequence contains an. X'-weakly convergent subsequence, then X is norm 
reflexive. 


We shall not give a complete proof of this theorem. It was first proved 
under the additional assumption that X is separable (Banach 1, pages 
189-191). After a great deal of development of the subject of weak 
topologies it was proved that, if X is a Banach space and S is a set in X 
which is closed relative to the topology F(X, X") and conditionally sequen- 
tially | X'-weakly compact, then S is compact relative to 7(X, X") 
(Eberlein, 1). Theorem 4.61-D is a consequence of this result, in view 
of Theorem 4.61-C and the fact that (x:||x| < 1} is closed relative to 
T (X, X?) (see problem 9, 8 4.4). 

A partial outline of the proof of Eberlein's result runs as follows: 
consider the canonical image J(S) of S in X". Since S is bounded (in 
the norm sense), so is J(S). The difficult thing to prove is that J(S) is 
closed relative to the topology 7(X", X^). Once this is done, Theorem 
4.61-A shows that J(S) is compact relative to .Z(X", X"). Finally, S 
itself is compact relative to .7(X, X’), because J-! is continuous in the 
relevant topologies. The proof that J(S) is closed relative to .Z (X", X") 
makes use of the important theorem 4.62-B, which we state, but do not 
prove, in the next section. Use is also made of the interesting fact (see 
problem 4, § 3.81) that, if K is a convex set in X, its closure in the norm 
topology coincides with its closure in the topology 7 (X, X"). 
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For further information about compactness relative to the topology 
7 (X, X'), see Dunford and Schwartz, 1, Chapter V, § 6. 


PROBLEMS 
l. Let X be a normed linear space, and suppose Xj, ::: x, €X’. Suppose 
€4, ** *, &, are scalars, that B > 0, and that [Ajo + --- + A,a,| < Bx + 
eee + A,x,’|| for every set of scalars Àj, +++, A, Then, to each ô > 0 corre- 
sponds some x with |x|| < B + 8 and x;(x) = oj, i— 1, --:, n. Outline of 


proof: Let T be the mapping of X into /?(n) defined by Tx = [x,/(x), ++ +, x, (Q1. 
Let K = (x:/x! < B + 8}. Show that there exists a linear functional on /"(zt) 


with value 1 at (o, «+ -, «,) and of absolute value not exceeding 1 on T(K). If 
the value of this functional at (£i, -- - £j) is Ai; +--+ + A,£,, deduce the 
contradiction Aja; +--+ + A,«, = 0. This is Y. Mimura's proof of a result 


due originally to E. Helly. See Kakutani, 1, page 171. 


2. Use the result in problem 1 to arrive at (4.61-1) in a different way, thus 
giving an alternative proof of Lemma 4.61-B. Take B = !|xo”|!, e; = xo (xi). 
Then x, can be chosen as a suitable multiple of the x obtained by using problem 1. 

3. A normed linear space X is called uniformly convex if to each € > 0 
corresponds (e) > O such that |x + yl < 2X1 — 8(€)) when lix! < 1, Iyl < 1 
and |x — y| > e. This concept is due to Clarkson, 1. Every uniformly 
convex Banach space is norm reflexive. This has been proved in different ways 
by Milman, 1, Pettis, 1, and Kakutani, 1. Kakutani's argument depends on 
problem 1. It will suffice to show that, if x9” € X" and |Ix9”!| = 1, then xo" e ZO), 
J being the canonical mapping of X into X". Choose x,’ € X’ so that |x,’ = 1 
and x9’(x;’) > 1 — (1/K). Applying problem 1 with B = 1 and o; = xo (xi^, 
i= 1,--*, n, we obtain x, € X so that |Ix,!| < 1 + (1/2) and x; (x) = xo xi), 
i= ],:::,n. Use uniform convexity to deduce a contradiction if one assumes 
that {x,} is not a Cauchy sequence. Then x, — Xo, and it follows easily that 
xoll = 1, x,'(xg) = xo'(x,) for n = 1, 2, ---. Using uniform convexity again, 
it can be seen that these last mentioned conditions determine x, uniquely. 
Now suppose xo/€ X¥’. Proceeding from problem 1 again, we obtain y, € X 


so that |y,| < 1 + (1/n) and x;//(y,) = xo (xr) if i = 0, 1, +++, n. Then {Yn} 
is a Cauchy sequence with limit yọ such that |!yoll = 1, x,'(yo) = xo (xn) if 
n=0,1,--:. By the uniqueness, yo = xo and hence Jxo = Xp”. 


4.62 Saturated Subspaces of a Conjugate Space 


If X is a normed linear space, the topology .Z(X', X) is weaker than 
J(X', X^), which in turn is weaker than the topology generated by the 
norm in X'. A subspace of X’ is closed relative to .Z (X', X") if and 
only if it is closed in the norm topology (by Theorem 3.81-C). Because 
J (X', X) is weaker than .Z(X', X^), it follows that a subspace of X' 
which is closed relative to .Z (X', X) is also closed relative to 7(X’, X"). 
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The converse is not true in general; in fact, as we shall see, if X has the 
property, that every subspace of X’ which is closed relative Z(X', X") 
is also closed relative to 7(X’, X), then X must be norm reflexive. 


Theorem 4.62-A. A subspace M of X' is closed relative to 7(X', X) 
if and only if it is saturated. 


PROOF. Suppose M is saturated and that xy € X’ — M. Then there 
exists some x, € 9M such that x9'(xj) # 0. Choose e so that 0 « e < 
[xo (x)|. Then (x':[x'(xj) — xo'(xj)| < e} is a neighborhood of xo’ in 
the topology 7(X’, X). This neighborhood does not intersect M, and 
so M is closed. 

Now suppose that M is closed relative to .Z(X', X). We can assume 
M + X', for X’ is saturated. Suppose x9’ € XY' — M. The fact that 
M is closed means that there exists e > 0 and x4, -: -, x, € X such that, 
if x’ e M, then 


(4.62-1) [x'(xj) — xo(x)] > e, i= 1,2, n. 


Let T be the linear mapping of X’ into /2(n) defined by Tx’ = 
{x (x1), +++, x(x)). Then T(M) is a closed subspace of /2(n), and it 
does not contain Tx’... Hence there exists a linear functional on /?(n) 
which has the value 0 on T(M) and a nonzero value at Tx’. Let 


> o;£; be the value of this functional at the point (é,,---, én). Define 


i=] 
n 


Xo = > a,x; Then x'(x9) = 0 if x’ € M, and x9'(%9) # 0. This proves 
i=l 
that M is saturated. The proof is now complete. 
We have not the space or the need in this book to push very far with a 
study of saturated subspaces. However, we mention without proof the 
following very important theorem. 


Theorem 4.62-B. Let X be a Banach space. Let M be a subspace of 
X’ such that M O {x’:||x’|| < 1} is compact relative to Z(X', X). Then 
M is saturated. 

In view of Theorem 4.61-A, the word “compact” may be replaced by 
"closed" in the statement of Theorem 4.62-B. This theorem, due to 
Dieudonné (1, Theoréme 23), is closely related to Lemma 2, page 119 
in the book 1 of Banach. 


PROBLEMS 


l. Suppose x" e X^, and let M = {x’:x’(x’) = 0}. Then x" eJ(X) if and 
only if M is saturated. In proving the “if” part use Theorem 3.5-C. 
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2. The space X is norm reflexive if every subspace of X’ which is closed in 
the norm topology is saturated. See problem 1 of § 4.6 for the converse. 


3. Use Theorem 4.62-B to prove the “if” part of Theorem 4.61-C without 
using Lemma 4.61-B. Using the notation of these propositions, observe that 
J(S) = J(X) A S^, and deduce that J(. X) is saturated, whence J(X) = X". 


4. Let M be a subspace of X', and let M be its closure in the topology 
JZ(X', X). Then M = X' if and only if M is total. Note that “M is total" 
can be expressed in the form °M = (0). 


4.7 Theorems about Continuous Inverses 


Throughout this section we assume that X and Y are normed linear 
spaces and that 4 € [X, Y], whence A’e[Y’, X’]. In some cases we 
assume completeness for X or Y; these assumptions are made explicit in 
each case. The conjugate spaces X’, Y’ are complete, in any event. 


Theorem 4.7-A. J(A') = X' if and only of A^! exists and is 
continuous. 


PROOF. Suppose that #(A’) = X’ but that A does not have a contin- 
uous inverse. Then, by Theorem 3.1-B, there is a sequence {x,} such 
that x, x 0 and |Ax,l/l|x,!| — O0. Let 


(E s 2 a, 
ae «E eM), ri Mn ull 


Then ||u,|| = 1. oo, and 


ESAME Pa UR mi a) > 


But then y'(4u)—0 for each y'eY'. Since A&A‘) = X' and 
y (Au,) = <Au,, y» = <u,, A'y'», this implies that x'(u,) — 0 for each 
x' € X'. But then, Theorem 4.4-Da implies that (|[u,]] is bounded, which 
is a contradiction. 

Now suppose, conversely, that 4 has a continuous inverse. If x' is 
fixed in X’ and y is variable in Z(A), x'(4-1y) defines a continuous 
linear functional on A(A). This functional can be extended to all of Y, 
the extension being a member of Y’ (Theorem 4.3-A). That is, there 
exists y' € Y' such that y'(y) = x'(A-1y) when y € Z(A4). Thus y'(Ax) = 
x'(x)foreach x EX. This means that x’ = A'y'. Therefore #(4’) is all 
of X'. The proof is now complete. * 
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Theorem 4.7-B. Suppose that Y is complete and that (4) = Y. 
Then A' has a continuous inverse. 


PROOF. The argument is very much like that in the first part of the 
proof of Theorem 4.7~A. If A’ did not have a continuous inverse, we 
should be able to assert the existence of a sequence {y,’} such that 
ly, | — «eo and ||A’y,'|| — 0. Then <x, A'y,» > 0 for each xe X. Since 
«x, A'y4 Y = (Ax, y,» and (A) = Y, this means that y,'(y) — O0 for 
each y € Y, Since Y is complete, we see by Theorem 4.4-D»b that {|| y, 
is bounded. This is a contradiction, so the theorem is proved. 

The next theorem is in the nature of a converse of Theorem 4.7-B. 
But the proof is more complicated, and we need to assume that X is 
complete. 


Theorem 4.7-C. Suppose that X is complete and that A' has a 
continuous inverse. Then &(A) = Y. Moreover, it follows that Y is 
complete. Finally, A`! is continuous, if it exists. 


PROOF. For each a > 0 let B, = (x:|x|| < a}. We first prove that 
the set A(B,) contains a neighborhood of 0 in Y. This part of the proof 
does not require X to be complete. The set B, is convex and balanced, 
so the same is true of A(B,) and A(B,) Suppose that, for some a, 
‘A(B,) does not contain a neighborhood of 0. Then there exists a 
sequence {y,} in Y such that y,— 0 and yp, ¢A(B,). Let d, be the 
distance between y, and A(B,). If yg € A(B,), consider the closed sphere 
íy:lly — yoll < d,/2), and (for a fixed n) the union S, of all such spheres 
corresponding to all choices of yo. Let V, = S,. By a very simple 
argument the convexity of 4(5,) implies that of S,, and hence V, is 
convex. Likewise, V, is balanced. Since 0 € A(B,), V, contains 0 as an. 
interior point. Hence «y,c€ V, if e is sufficiently small. However, 
Yn € Va; therefore, if e, is the largest positive value of e such that «y, € Vm 
we know that e, < 1 and that e,y, is on the boundary of V,. By Theorem 
3.7-D there exists an element y'e Y' such that y'(e,y,) = 1 and 
|y(y) <1 if y eV, In particular, |y'(4x)) < 1 if [ix € e, and 
|y'(Ax)| < «7! if |x| < 1. This means that |4'»'| € «1. Now, the 
fact that A’ has a continuous inverse means that ||(A‘)~1x’l| < ml|x'|| for 
each x’ € &(A’), where m is some positive constant. If x’ = A'y' we then 
have || < mort. Then 1 = y'(ey,) < [Y lenya] < mo-!|y,ll, because 
O0<e«,< 1. But |ly,|| > «a/m contradicts the fact that y,—-0. This 
shows that A(B,) contains a neighborhood of 0. 

The rest of the proof is much like the last part of the argument used in 
proving assertion 1 of Theorem 4.2-G. There is some 8 > 0 such that 
{y:|lyll < B) < A(B,. Choose the values 1, 2-!, 2-2, ---, 2, --+ for 
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«, and denote corresponding values of B by Bo, Bis ---, Bm >+ Choose 
any yo for which || yol] < £o. Then yo € A(B,) for « = 1, and hence there 
exists an element y, = Ax, with |x| < 1, such that ||yo — yil| < By. This 
implies yg — y, € A(B,) with « = 2-1. By induction we obtain elements 
Yn = Ax,, with ||x,l| < 1/2771, such that || yo — yı — ::: — y,l € n and 
hence yp — yı —::- — y, € A(B,) with œ = 2. Now |Ax|| < [Alle if 
\|x|| < «. Therefore |yl| < l[A]|e if y € A(B,). This shows that f, — 0, 


and hence that 
Jo = > n. 
1 


oo 
Since X is complete and 2 ||x,|| is convergent, the series > X, converges 
1 1 


o 
and defines an element x; € X. Moreover, Axo = > AX, = yg. This 
1 


shows that íy:|yl| < 89) € BA); it follows by homogeneity that 
RA) = Y. 

It remains to prove that Y is complete. Let f be the completion of 
Y, and define A e [X, Î] by writing Ax = Ax if x € X. As we remarked 
in § 4.3, we can identify f' with Y'; hence we can identify (A)’ with 4’. 
It follows that (A)’ has a continuous inverse, and so, by what has already 
been proved, we know that @(A) = f. But &(A) = AA), and so 
f = Y; it follows that Y is complete. The fact that A~! is continuous, 
if it exists, now follows from Theorem 4.2-H. 


4.71 The States of an Operator and its Conjugate 


The theorems in § 4.7, together with some of those in §§ 4.2, 4.6, make 
it possible for us to tabulate in diagrammatic form a large number of 
interesting and useful implications involving a bounded linear operator 
and its conjugate. In order to tabulate information concisely, we make a 
ninefold classification of what we shall call the state of an operator. If 
Aeé[X, Y], we list three possibilities for Z(A), labelling them I, II, III, 
as follows: 


I, AA) = Y. 
Il. BA) = Y, but AA) # Y. 
II. AA) + Y. 
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As regards 4-1! we also list three possibilities, labelling them 1, 2, 3: 


1. A`! exists and is continuous. 
2. A`! exists but is not continuous. 
3. 4-1 does not exist. 


By combining these possibilities in all possible ways we obtain nine 
different situations. ‘For instance, it may be that 2(A) = Y, &(A) + Y, 
and that A~! exists but is discontinuous. We shall describe this as state 
If, for A; alternatively, we shall say that A is in state II,, There are 
nine states in all: Ij, Iz, I4, IL, - - -, IL, II. 

The notion of the state of an operator can be applied, in particular, to 
A’. Here A’ replaces A and X' replaces Y in the description of the states; 
to say that A’ is in state I, means that #(A’) = X’ and A’ does not have 
an inverse. 

It is possible for A to be in any one of the nine states if no restrictions 
are placed on X and Y. But, if we assume that Y and Y are both 
complete, it is impossible for A to be in state I,; this is a consequence of 
Theorem 4.2-H. Since X' and Y' are always complete, this shows that 
A’ can never be in state J,. Likewise, if X is complete, A can never be 
in state II,. For, it follows by Theorem 4.2-B that A is closed; hence, if 
X is complete and A has a continuous inverse, Theorem 4.2-E shows that 
ZI (A) is closed, so that (A) = Y # AA) is impossible. Applying this 
result to A’ (noting that Y' is complete), we see that A’ can never be in 
state IT,. 

Next we define the state of the pair (A, A’); this is the ordered pair of 
the states of A and A’, respectively, with the state of A listed first. We 
shall now proceed to construct a diagram which shows the states of the 
pair (A, A’) which are demonstrated to be impossible because of various 
theorems in $8 4.2, 4.6, and 4.7. This diagram is a large square, divided 
into eighty-one smaller squares arranged in rows and columns. We label 
each column by a state symbol placed at the bottom; this denotes a certain 
state for A. We label each row by a state symbol placed at the left; 
this denotes a certain state for A’. The square which is the intersection 
of a certain column and row denotes a state of the pair (A, A’) [the inter- 
section of the I, column and III, row denoting the state (Iz, IIL), and 
so on]. 

We cross out a small square by its diagonals if the corresponding state 
is impossible by virtue of our theorems, without requiring X or Y to be 
complete. The reader should now examine the state diagram, as it 
appears on page 237. We shall explain briefly the reasons for the crossing 
out of those squares which are crossed out. All squares in the I, and 
II, rows are crossed out, since A’ can never be in these states; this was 
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explained earlier. Theorem 4.6-E says that, if 4 is in a I or II state, 
A’ must be in a 1 or 2 state, and vice versa. Thus any state of the pair 
with I or II for A and 3 for A’ is impossible; also, III for A and 1 or 2 for 
A’ is impossible. Theorem 4.6-H says that a state of the pair with 3 for 
A and I or II for A’ is impossible. Theorem 4.7-A says that we have | 
for A if and only if we have I for A’. This eliminates states with 1 for A 
and II or III for A’ and also those with 2 or 3 for A and I for A’. All 
but sixteen of the eighty-one squares are crossed out as a result of the 
foregoing considerations. These sixteen remaining states for the pair 
(A, A’) are all possible, if no restrictions are placed on X or Y; this has 
been shown by the construction of examples (see Taylor and Halberg, 1). 
Some of these examples are considered in the problems. Many implica- 
tions can now be read from the state diagram. Samples: The state of A 
is HI, if and only if the state of A’ is I}; if the state of A is IIL;, the state 
of A’ is either II, or HI}. 

Next we consider the effect of assuming that X is complete. Theorem 
4.7-C tells us, in this case, that any state except I, and I; for A is impossible 
if we have | for A’. Of the sixteen states previously not crossed out, this 
rules out (L;, II), AL, L), (IL, IIT), and (II, III). These exclusions 
are indicated on the state diagram by putting the letter X in the 
corresponding square. 

Now consider the effect of assuming that Y is complete. Theorem 
4.7-B says, in this case, that I for 4 makes 2 and 3 impossible for A’. 
This rules out (L;, IT,), (Iz, HII;), and (T,, IIL;), in addition to some states 
already crossed out. These exclusions are indicated by putting a Y in 
the appropriate square on the state diagram. 

With X and Y both assumed to be complete, there are nine states still 
left as apparently possible for the pair (A, A’). Examples exist which 
show that these states are actually possible. 

If we assume that X is norm reflexive, but make no restrictions on Y, 
Theorem 4.6-I and problem 1 of $4.6 tell us that we must have I or II 
for A’ if we have 1 or 2 for A. Hence, if X is norm reflexive, in addition 
to the states ruled out because X is complete, this rules out (L,, III), 
(IL, IHI) and (II, III4) from the sixteen states which are not crossed 
out by their diagonals. These three exclusions are indicated by X — R 
in the corresponding square on the state diagram. 

It is now interesting to observe, on the state diagram, that when X is 
norm reflexive and Y is complete, there are seven state squares left blank. 
Also, there is at most one blank square in any one row or column. Hence, 
with these conditions on X and Y, the state of either A or A’ determines 
uniquely the state of the other. These seven states for the pair (A, A’) 
do actually occur; examples can be constructed with Y = Y = P. 
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PROBLEMS 


In the first nine problems are given examples of operators A which provide 
illustrations of various states for the pair (A, A’). In these examples X and Y 
are chosen from the spaces /?(1 < p < oo) and (co). In each of these spaces 
we denote the vector (0, - - - 0, 1, 0, -- -) (with 1 in the kt» place) by uy. In i7, 
with 1 < p < co, and (c) the set {u,} is a countable basis, and in defining A on 
these spaces it suffices to define Au, for each k. If X and Y are both spaces in 
which {ux} is a countable basis, A’ is determined by the transpose of the infinite 
matrix which represents Æ. In each problem it is left for the reader to show 
that the state of the pair (A, A’) is as indicated. 

I. X= Y= l. Au, = 2!-ku,. The state is (II7, IL). 

2. X = lI, Y = P, A asin problem 1. The state is (II, III). 

3 X= Y=. Au, = 0, Au, = u,ifk > 2. The state is (IH, HI3). 

4. X= Y= P. Au, = 0, Au = HUk-—1, k z 2: The state is (I5, III). 

5. X¥=Y=[, Aux = kt. The state is (III,, Ij. 

6 X=Y=] Au —0,A4u, = > 2!-iu. The state is (Il III). Note 
i-K-1 


that A(uy — upt) = 227, i ifk > 2. Also that > 21-u;, is not in 4(A). 
1 


7. X-Y- D. Au, = 21k (u, + -+-+ ug). The state is (II, IT). We 
can also take X = Y = (cp) in this case. 

8 Y- Y- Au, = U2, Au, = ug + Ug if k > 2. The state is (IL, 
II;. Note that uz% is in @(A), but u;,-, is not. But it can be shown that 
24-1 € AA), 

9. X = Y = (cg). Au, = 2u, — un, Aug = — Uk- + 2uy — Ups, if k 22. 
The state is (II, IL). 

10. Suppose A e [X, Y] and 4A) = Z z Y. Define Be [X, Z] by setting 
Bx = Ax when x e X. Suppose also that Y is complete and (4) = Y. Then 
we can identify Z’ with Y’ and B’ with A’. The states of A’ and B’ are the 
same, but, if the state of A is II; (i = 1, 2, 3), that of B is Ij. In this way we 
can produce examples of states (I, II;), (12, HI), and (13, I3) from some of the 
earlier examples. 

Il. X the subspace of /? generated by {u,}, Y = P. as in problem 4, but 
with this change in X. The state is (II,, III,). 

I2. X the subspace of (cg) generated by {u,}, Y either X or (co) itself. 
Au, = uy, Au, = — 2uy-4 + Uz if k 2 2. The state is (IL, IIT) if Y= (co) 
and (I), III) if Y = X. 

13. If Y is a complete space and X is a proper but dense subspace of Y, let 
Ax = xforxeX. Then A e[X, Y] and the state of the pair is (II, I,). 

14. X the subspace of l! generated by {ux}, Y either X or l! itself. 


oo 
Au; = > zu Au; = ujy-, if k => 2. The state is (IL, III;) or (12, HI)) 
I 


according to whether Y is /! or X. 
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I5. Let Y be any Banach space of infinite dimension, and let H be a Hamel 
basis for Y with all elements A of H such that hl] < 1. If y e Y and y = ah, + 


n 
+++ +oa,h,, let N(y) = > |«;|. Let X be the space with the same elements as 


E i-i 
Y, but with Nasa norm. Let Ay = y, and consider A as an element of [X, Y]. 
The state is (L,, III). 


16. If X and Y are linearly homeomorphic and X is norm reflexive, so is Y. 
Suggestion: Let A be the linear homeomorphism of X onto Y. Determine the 
state of A” by using the state. diagram. Consider the canonical mappings: 
J, of X onto X^ and J, of Y into Y". Express J; in terms of J}, A" and 4-1. 


17. Suppose Ae[X, X']. Assume that Z(4)- Z(A4). If X is norm 
reflexive, show that the only possible states are (I;, I1), (IL, I2), (IIT;, HT). 


18. Suppose A e LX, X], that A = A’J, and that X is norm reflexive. Then, 
the states of 4 and 4’ are the same, and the only possible states of A are I, 
IL, HI. 


19. Suppose Ae [X]. Let B be a linear homeomorphism of X onto X’, and 
suppose A = B-!A'B. Then, the only possible states for A are I}, IL», UI. 


4.8 Projections 


Operations of a special type, called projections, play an important role 
in the systematic study of linear operators. The notion of a projection 
is closely related to the concept of a direct sum of linear manifolds, and 
it is with this concept that we begin this section. 

Let M,,---, M,(n > 2) be linear manifolds in a linear space X. We 
say that this set of linear manifolds is linearly independent if no M; 
contains a nonzero vector which is in the linear manifold determined by 
the remaining n — | linear manifolds. An equivalent condition is that 
if x; € M; and ox, +--+-+ a,x, = 0, then x, — 0 if a, #0. The 
linear manifold generated by the elements of M; U - - - U M, is denoted 
by M, @--- ® M, and called the direct sum of Mj, ---, M,. Elements 
x of the direct sum are representable uniquely in the form x = xq +- 
tox, with x; € M;. 

Whenever we use the @ notation, it is to be understood implicitly that 
the manifolds in question are linearly independent. 

If X = M, ®---@M,, the representation x = x, +--+ + x,, with 
X; € M,, determines operators P4, ---, P,, defined by P;x = x;. These 


operators are linear, and they satisfy the relations 
PP,=0 ifi#j, P2-P, 

(4.8-1) { fd mite: 
I-P t+. +P, 


Conversely, if the linear operators P}, ---, P, are given, with domains X 


§ 4.8] GENERAL THEOREMS ON LINEAR OPERATORS 241 


and ranges M,,---, M,in X, and if they satisfy the conditions (4.8-1), it 
follows that XY = Mi ®---@M,, 


Definition. A linear operator P with domain X and range in X is 
called a projection (of X) if P2 = P. If M is the range of P, then P is 
called a projection of X onto M. 


It is easily seen that, if P is a projection of X, then 
(4.8-2) X = RP) D NP). 
The direct sum representation of an element is 
x = Px + (x — Px). 


The operator Q = 7 — P is also a projection; its range is (P). 
Elements x of #(P) are characterized by the fact that Px = x. 

When X = M, ® Mn, we say that M; is a complement of (or is 
complementary to) M,. Thus, (4.8-2) says that, if P is a projection, 
N (P) is complementary to Z(P). There can be more than one complement 
of a given linear manifold. 

As for the existence of complements of a given linear manifold, we have 
the following result: 


Theorem 4.8-A. IfM is a linear manifold in the linear space X, there 
exists a projection P of X whose range is M. 


PROOF. The cases M — (0) or X are obvious, so we set them aside. 
Let f be the linear operator with domain and range M, defined by f(x) = x. 
Take Y = M in Theorem 1.71-A. Then the F of Theorem 1.71—A will 
serve as P for our present purpose. 

Thus far nothing has been said about topology in connection with 
projections. 


Theorem 4.8-B. Jf X is a topological linear space and if P is a 
projection of X which is closed, the range of P is closed. 


PROOF. Suppose y €e A(P). If V is any neighborhood of y, it contains 
a point of Z(P), say z = Px. Then Pz = z, and (z, z) is a point of the 
graph of P. But also, (z, z) e V x V, which is a neighborhood of (y, y) 
in the product space X x X. Hence, since V is arbitrary and the graph 
of P is closed, (y, y) is in the graph. That is, Py = y, and so y € (P). 
Hence Z(P) is closed. 


Theorem 4.8-C. Suppose X is a topological linear Ti-space. | Suppose 
P is a continuous projection of X. Then &(P) is closed. 


PROOF. A&(P) is the null space of the continuous operator I — P. 
Since (0) is closed, so is the inverse image (x:x — Px = 0}. 
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Theorem 4.8-D. Let X be a complete metric linear space. Let P be 
a projection of X such that both Z(P) and NMP) are closed. Then P is 
continuous. 


PROOF. Because of Theorem 4.2-I it suffices to prove that P is closed. 
Suppose x,— x and Px,— y. Then x,— Px,— x — y. Since Px,€ 
AP) and x, — Px E€ V(P), it follows that y € Z(P) and x — y e V(P). 
Then Px — Py = 0, or Px = Py = y. Thus P is closed. 

If X is a Banach space and M is a closed subspace of X, there may be 
no continuous projection of X whose range is M. In view of (4.8-2) and 
Theorem 4.8-D, this is the same as saying that there may be no closed 
linear manifold which is complementary to M. Examples have been 
given, even in reflexive spaces, by F. J. Murray, 1 and by A. Sobczyk, 1. 
It can also occur, even in Hilbert space, that M, @ M; is not closed, even 
though M, and M, are closed and linearly independent subspaces. In 
this case the associated projections of M, @® M; onto M, and M, are 
not continuous. For an example, see Stone, 1, pages 21-22. 

For inner-product spaces the notion of direct sum of linear manifolds 
is of particular importance in connection with the concept of mutually 
orthogonal linear manifolds. 


. Definition. Two linear manifolds M, N in the inner-product space X 
are said to be orthogonal if (x, y) = 0 whenever x e M and ye N. A 
family of linear manifolds is called an orthogonal family if each pair of 
distinct manifolds from the family are orthogonal. 

If M,,---, M,isan orthogonal family of linear manifolds, the manifolds 
are linearly independent. For, if a,x, +--+ + a,x, = 0, with x, € Mp, 
the orthogonality shows that 0 = (a,x, +--+ + o,x,, Xp) = ojlx,ll2, and 
hence x, = O if «, £ 0. 

A direct sum of orthogonal closed linear manifolds in a complete space 
is closed. We state this formally. 


." Theorem 4.8-E. Jf X is a complete inner-product space and if M, N 
are orthogonal closed linear manifolds, M Ð N is closed. 


PROOF. If xe M and y €N, an easy calculation shows that lx + yll = 
lxi? + lyl|[?. Now suppose that z, € M ®© N and that z, — z. We can 
write Z, = X, + Yn, x. € M, y,€ N. Then 


(Za — Zw? = |lX. — Xml? + ya — Yell?» 


Since {z,} is a Cauchy sequence, so are {x,} and {y,}. If x,— x and 
Y,— y, we have z=x+y. But xe M, ye N, since M and N are 
closed. Hence z € M @ N, and the proof is complete. 
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PROBLEMS 


l. Suppose X is a Banach space, Mı, -+ +, M, are closed and linearly inde- 
pendent subspaces of X, and M = Mı O--: OG M,. Suppose that the 
projections P,,---, P, of M onto M1, - - +, M, respectively, associated with the 
direct sum, are continuous. Then M is closed. 


2. If X is a complete metric linear space, if M = M, ® M2, where M, and 
M^; are closed and linearly independent subspaces, and if M is closed, the 
associated projections of M onto M, and M; are continuous. This does not 
generalize for more than two M,’s. 


3. If X is a Banach space and Mi, M3 are closed and linearly independent 
subspaces of X, then M, ® M^; is closed if and only if there exists a d > 0 such 
that [x1 — x2|| > d whenever x; € Mi, x? € M», and |lxill = lx! = 1. 

4. Let X be a normed linear space. Let P, and P; be continuous projections 
of X such that Z = P, + Pj. Let M, be the range of Pz, so that Y = M, © Mh. 
Then P,' is a continuous projection of X’. The range of P;’ is M59, and the 
range of Py’ is M;?. Finally, X’ = Mj? ® M2. 

5. If P is a projection on any linear space, show that (A — P)^! = A-1I + 
ATIA — DAP if AA — 1) z 0. 


4.81 Continuous Linear Functionals on a Hilbert Space 


We have seen, in Theorem 4.32-A, that every continuous linear 
functional on /? is representable in the form 
[ve] 
XQ) = Yeh, x= Eder, 


æ i 
I'l = (5 eJ) < ©. 
1 


This result can be restated as follows, by defining y = {é,} as an element 
of /?: to each x’ € (I?)' corresponds a unique y € /? such that x'(x) = (x, y) 
for each x €/2. In this form the result is valid for an arbitrary Hilbert 
space, or, since it is true for finite-dimensional as well as for infinite- 
dimensional spaces, it is valid for all complete inner-product spaces. To 
prove this we need two preliminary theorems. In each of the three 
following theorems it is assumed that X is a complete inner-product space.. 


where 


Theorem 4.8I-A. Let S be a nonempty closed convex set in X, and 
suppose d = inf ||x\|. Then, there exists a unique x € S such that ||x|| = d. 
xeS 


PROOF. From the way in which the norm is defined in terms of the 
inner product, it follows that 


(4.81-1) lx + yl? + lix — vl? = zx + iyi?) 
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for all pairs x, y in X. Now suppose that x, € S and |x,|| — d. Since 
S is convex, !/2(x, + Xm) € S, and so 


2 d. 


Xn + Xm 
To 


From this inequality and (4.81-1) we have 


lx, — xl? = Q(X ql? + El) — 1x, H xul? 
€ 2(Ilx,l? + lixsi2) — 442, 


whence, since [[x,|? > d?, it appears that (x,) is a Cauchy sequence. If 
Xx,— x, it follows that xe S and |x| = d. To see that x is unique, 
suppose x and y are in S and that ||x|| = ||jy|| = d. Then, since S is 
convex, 


d< M < Albdl + Ziyi = d. 


It then follows by (4.81—1) that 
Ad? + [ix — yl? = 4d?. 
whence x — y. 


Theorem 4.8I-B. Let H be the closed hyperplane (x:y'(x) = 1} 
where y' is a fixed nonzero element of X'. Then, there is a unique z e H 
such that (x, z) = 0 whenever y'(x) = 0. i 


PROOF. H is nonempty, closed, and convex. Hence, by Theorem 
4.81—A, there exists z € H such that |iz|| = inf ||xl. Now choose any x 
xeH 


such that x #0 and y'(x) — 0. We wish to prove that (x,z) — 0. 
Define 

(z, x) 
(4.81-2) m y Z = de X, Z2 = Z — Z4. 
Then y'() = 0, and so y'(z;) = y'(z) = 1 (since z e H}. Hence z, € H. 
It follows that |z;| > lzl. But, from (4.81—2) it follows that (zi, z;) = 0 
and hence that 


(4.81-3) lizi? = (z1 + 22, z1 + z2)  llzill? + lizall2, 


whence [izj| < llz|. Therefore |iz;l| = |iz|, and consequently, by (4.81-3), 
zi, — 0. Since x # 0, this implies (x, z) = 0. To see that z is unique, 
suppose that w also has the properties asserted for z. Then y'(w — z) — 
y'(w) — y (2 = 1 — 1 = 0, and hence (w — z, z) -(w—z,w) = 0. But 
then ||w — zl2 = 0, or w = z. ` 

We now come to the main representation theorem. 
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Theorem 4.8I-C. To each y' € X' corresponds a unique y € X such 
that y'(x) = (x, y) for every x. 


PROOF. It is clear that there cannot be more than one such y, for if 
yı and y; meet the requirement, it follows that (x, y; — y2) = 0 for every 
x, so that, in particular, |y, — yl? = 0 and y; = y». If y' = 0 we can 
take y = 0, so we assume y' # 0. Choose z as in Theorem 4.81-B. 
Now, (x, z) is a linear functional of x; hence, by Theorem 3.5-C, there is 
some scalar « such that (x, z) — «y'(x) for every x. Putting x — z, we 
obtain |zl? = «y'(z) = a. Hence y'(x) = (x, z)/lzl? for every x. We now 
let y = z /liz? and the proof is complete. 


PROBLEMS 


laf y’, y, and z are related as in the proof of Theorem 4.81-C, show that 
lyt = lyi = l/lizl. Thus the distance from 0 to the set (x:y'(x) = 1} is 
Vll. ug LL 
ERE ;j : 
2. If X is a complete inner-product space, X and X' are congruent. For the 
complex case use the result at the end of § 3.2. 
3. A Hilbert space is norm reflexive. 


4. Let M be a closed linear manifold in the complete inner-product space 
X. If xe X, define Qx as the unique element of N = x + M such that 
lQxi| = inf|lyli (use Theorem 4.81-A). From [lQxl? < liQx + emi? if m e M, 

yeN 


show that Qx is orthogonal to M [choose « = — (Qx, m)/iim(?]. Note that 
x = (x — Qx) + Qx and that x — Qx e M. The element x — Qx is called 
the orthogonal projection of x onto M. Observe that Qx = 0 if x € M. 


5. Use the result of problem 4 to give an alternative proof of Theorem 4.81- B. 
Take M = (x:y'(x) = 0}. 


4.82 Orthogonal Complements 


In this section X denotes an inner-product space. Completeness is 
not assumed except as stated explicitly. 


Definition. If S is a nonempty subset of X, the set of all x such that 
(x, y) = Oif y € S is called the orthogonal complement of S, and is denoted 
by S+. 


A number of simple facts are at once evident: 
(0): = X, X+ = (0), 
S, c S, implies $5 C S4, 
xeSn SŁ implies x = 0. 
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The set S- is a closed linear manifold. If M is the closed linear manifold 
generated by S, then M+ = SŁ. 

We denote (S-)- by S- +. Itis obvious that Sc S- L, 

The main theorem about orthogonal complements is the following: 


Theorem 4.82-A. If X is complete and if M is a closed subspace of 
X, then X = M Q MŁ. 


PROOF. Choose any y € X. The inner product (x, y), as x varies over 
M, defines an element of M’. Since M can be regarded as a complete 
inner-product space, Theorem 4.81-C asserts the existence of an element 
y1€ M such that (x, y) = (x, yı) if xe M. Let y; =y — y, Then 
y2 € Mi, for (x, y2) = (x, y) — (x, yp = Oif xe M. Writing y = y, + 
y», we have the proof of the theorem. 

If we write Py — y, in the foregoing notation, P is a projection with 
range M. It is called the orthogonal projection of X onto M, because of 
the fact that x — Px e Mi. We note that a different proof of Theorem 
4.82-A is indicated in problem 4 of § 4.81. 


PROBLEM 


Suppose X is a complete inner-product space. If y' c X' is represented by 
y(x) = (x, y), let Ey = y’, so that E is an operator which maps X onto X’. 
Show that annihilators (as in § 4.6) and orthogonal complements are related as 
follows: If S — X, then 

S° = E(Sj, SL = E-W(S9), 


and (S9) = Si, 


4.83 Dirichlet's Principle 


The subject matter of this section illustrates the usefulness, in potential 
theory, of the notion of the direct sum of two orthogonal subspaces of an 
inner-product space. 

Let R be a bounded open set with boundary B(R), in Euclidean space 
of three dimensions. We suppose, furthermore, that B(R) is smooth 
enough to enable us to apply the divergence theorem to vector fields which 
are continuously differentiable in R. In particular, then, with adequate 
continuity and differentiability we have the identity of Green 


(483-1) Í gV2h dV + Í Vg-Vh dV = Í g 2" qs, 
R R Bg On 
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where g and A are real-valued functions defined in R, V? denotes the 
Laplacian, V the gradient, and n the outward normal to B(R). 

We define a real inner-product space ¥ as follows: The elements f of 
F are the real-valued functions which are twice continuously differentiable 
in R. The inner product is 


(4.83-2) EYE NE fdS4 ic VA- Vf, dV. 


The space F is not complete. Let 4 be the subspace of those elements 
g € F which vanish on B(R), and let # be the subspace of those elements 
he7 which are harmonic (ie., V2h = 0) in R. From (4.83-1) and 
(4.83-2) we see that (g, h) = 0 if ge 4 and he #; that is, 4 and X are 
orthogonal. 

Now consider any h € X and any fe F such that f = h on B(R). Let 
g=f—h. Thenge 2. Since f= g + h, the orthogonality shows that 


(fll? = ilgli? + All, 


and hence || < ||f||. Thus, among all elements of which are equal 
to the given h on B(R), h has the smallest norm. This characterization 
of h by a minimal property is what is known as Dirichlet's principle 
(though originally the principle was not stated in the language of norms). 

In the early work in the calculus of variations, attempts were made to 
use Dirichlet's principle to prove the existence of a solution of the 
Dirichlet problem. Let us see how we might attempt to give an existence 
proof by linear-space methods. Suppose fọ is a given element of F. 
Denote by K the set of elements of F which coincide with fy on B(R). 
This set is precisely the set fo + 4. Since Y is a closed linear manifold 
in F, K is a closed-linear variety in F ; in particular, K is convex. If 
fo does not vanish identically on B(R), the distance d from 0 to K is 
positive, and there exists a sequence {f,} in K such that |f] — d. Just 
as in the proof of Theorem 4.81—A we see that {f,} is a Cauchy sequence. 
But, since Z is not complete, we cannot be certain that the sequence has 
a limit in F. (It is precisely here that this method fails in its attempt to 
provide an existence proof for the Dirichlet problem.) If a limit h does 
exist in F, then he K. In this case, the fact that h is the element of K 
with minimal norm allows us to conclude, by the standard reasoning of 
the calculus of variations, that h satisfies Laplace's equation, which is the 
Euler equation for this situation. Thus we can say: If fo; € F, the 
Dirichlet problem for the region R, with the values of fo on B(R) as assigned 
boundary values, is solvable if and only if there is a point of fo + 4 at 
minimal distance from 0. This “point” is then the solution of the 
Dirichlet problem. 
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It is interesting to observe that, if the Dirichlet problem is solvable, 
in the sense just described, for each fe F, we can write 


F=aG@X. 


Hence, if f = g + h, where ge 4 and he X, then h is the solution of 
the Dirichlet problem with boundary values of f. We can describe h as 
the orthogonal projection of F on X. 

This concept of orthogonal projections in connection with the Dirichlet 
problem became very well known in the 1930's and was utilized in various 
ways by research workers in the calculus of variations. It led naturally 
to various ‘schemes for overcoming the difficulties arising from an in- 
complete space. One line of development was that in which the space was 
taken to be complete and the basic Dirichlet problem was modified by 
generalizing the sense in which a function takes on prescribed values at the 
boundary of a region. We present a brief exposition of a paper by Weyl 
(1, especially pages 411-414). We now let R be any open set in Euclidean 
3-space. We consider vector fields F of class #2 in R and form a Hilbert 
space F with the inner product 


GF Í F,-F; dV, 
R 


by the usual formation of equivalence classes. We shall be interested in 
several subspaces of F. First we consider the vector-valued functions 
defined in R, each of which has the value zero outside of some compact 
subset of R and has continuous first derivatives in R. If G is such a 
function, its curl V x G determines an element of F; we denote by € 
the closed linear manifold in F generated by all such V x G. Next we 
consider real-valued functions defined and continuously differentiable in 
R, each of which vanishes outside of some compact subset of R. The 
gradients Vv of functions v of this kind generate a certain closed linear 
manifold in F, which we denote by 9. The elements of F which are 
orthogonal to € are called irrotational: those which are orthogonal to 4 
are called solenoidal. These are extensions of the ordinary meanings of 
these terms. We write F, for the class of irrotational elements and F, 
for the class of solenoidal elements. Note, in particular, that 4 c F, 
and € c F, That is, (Vo, V x G) = 0 for any v and G of the sort 
mentioned above. This would be obvious from the relation 


V.(G x Vv) = Vr-(V x G) — G-(V x Vo) 


if v were twice continuously differentiable. "With the weaker conditions 
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here placed on v a deeper examination of the situation is required. The 
discussion given by Weyl attends to this matter. 

By Theorem 4.82-A we have F = € (D, since F, = GY. Now 
consider the elements of F, which are orthogonal to 9. These are 


precisely the elements of F; ^N F, Hence 
F; Bm 4 Qn. 


The relation of all this to the Dirichlet problem (as well as to other 
problems of potential theory) depends on the following fundamental fact, 
which is proved in the reference already cited: If FEF; F, then F 
has derivatives of all orders in R, and the divergence and curl of F are 
both identically zero in R. It follows that the components of F are 
harmonic functions. Also, F is the gradient of a harmonic function; 
however, the latter function may be multiple valued, owing to the fact 
that R need not be simply connected. Suppose now that we start with a 
given scalar function f such that F = Vfisin F. Then Fe.F¥,, and we 
can write F = G + H, where H = Vh, h being harmonic, G = lim Vg,, 


and g, vanishes outside of some compact subset of R. It can be shown 
that this behavior of g, implies that, in a generalized sense, f — h is zero 
at the boundary of R. Thus A is the solution of a generalized Dirichlet 
problem. 


4.9 Adjoint Operators 


Throughout this section X and Y will denote arbitrary complete 
inner-product spaces. We use the same symbol (parentheses) for the 
inner product in both spaces. If A € [X, Y], we have defined A’ so that 
A'e[Y', X’]. However, because of Theorem 4.81-C, it is possible for 
us to identify X' with X and Y' with Y. In so doing, we are led to an 
operator belonging to [Y, X] which it is natural to consider in place of 
A’. Suppose yo is fixed in Y. Let x'(x) = (Ax, yo. Then x’ € X', and 
hence (by Theorem 4.81-C) there is a unique x, € X such that x'(x) = 
(x, xg). We write xg = A*yo, thus defining an operator A* on Y into X. 
The definition of A* is fully expressed by the equation 


(4.9-1) (Ax, y) = (x, A*y), xeX,yeY. 


The operator A* is called the adjoint of A. 
It is easy to see that A* is linear. It is also continuous, and 


(4.9-2) \|A*il = |All. 
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For hints as to the proof of this, see problem 1. 
The following formal properties of adjoints are easily verified: 
(A + B)* = A* + BY, («Af = àA*, | 0* = O27 


If J is the identity operator on X to itself, 7* = /. If Aq! exists and 
belongs to [Y, X], then (A*)~! exists, belongs to [X, Y], and 


(4.9-3) (4*)-1 = (471)*. 


If X, Y, Z are all complete inner-product spaces and if A e [Y, e and 
Be[X, Y], then ABe[X, Z] and 


(4.9-4) (AB)* = B*A*. 
We write (4*)* = A**. We often use the relation 
(4.9-5) A** = A, 


which follows easily from (4.9-1). 

— The relations between annihilators, ranges, and null manifolds, as set 
forth in 8 4.6, have counterparts in relations between orthogonal comple- 
ments, ranges, and null manifolds. The situation is simpler than that of 
§ 4.6, owing to the identification of X’ with X. A complete inner-product 
space is reflexive; and there are no nonsaturated subspaces of X’. We 
list the following results, leaving verification to the reader. 


(4.9-6) (HAH = W(A*); XA) = Warm. 
(4.9-7) HAH = NA); WA”) = NA). 


Next we state two simple but useful theorems. 


Theorem 4.9-A. .(A*) = W(AA*), and ZA) = RAA”). 

PROOF. Obviously /(A*)c W(AA*). If AA*y — 0, we have 
(4*y, A*y) = (AA*y, y) = 0, and so A*y —0. Hence .(AA*) c 
NW(A*). The first part of the theorem is now proved. Next, we observe 
that (44*)* = A**A* = AA*. Hence, by (4.9-6) and the first part of 
our theorem, #(AA*) = .K(AA*)- = W(A*)- = AA). This finishes 
the proof. : 


Theorem 4.9-B. /|A4*4A|| = [|4i? = ||AA* |. E 


PROOF. ||A*Axj| < ||A*|j || Axil < ||A*|| ||Ali ixi] = Axl, by (4.9-2). 
Therefore |j4*A4|| < ||4j?2. But also, ||4xj|2 = (Ax, Ax) = (x, A*Ax) € 
xil |A*Ax|| < [LA*AI| ||xj/2, whence 4i? < [4*4]. Thus ||A4*A|| = I|AIP. 
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We apply this result with A* in place of A, obtaining ||A**A*|| = ||4A*|| = 
\|A*||? = |L4]2. Thus all is proved. 

Let us now recall from § 4.71 the terminology about the nine possible 
States of a bounded linear operator. Since we are now considering A* 
instead of A’, it is important to know that the state of A* is always the 
same as the state of A’. That this is so follows from the very close 
relationship between A* and A’; we leave verification to the reader. As 
a consequence, 4* may replace A’ in the state diagram in § 4.71. Since 
X and Y are reflexive, there are just seven possible states for the pair 
(A, A*). 

We say that A is normal if AA* = A*A and self-adjoint if A* = A. 
Clearly a self-adjoint operator is normal, but the converse does not 
always hold. For a normal operator the number of possible states is 
severely limited. 


Theorem 4.9-C. For a normal operator A the only possible states are 
IL, Il, and HI,. The state of A* is the same as that of A. 


PROOF. By Theorem 4.9-A, applied to 4*, we have Z(A*) = ZI(A* A). 
Since A is normal, we then have A(A) = R(A*). It follows from this 
that neither of the operators 4, A* can be in a III state unless the other 
is also. If we now examine the state diagram (with A* in place of A’), 
we see that four of the seven possible states for the pair (A, A*) are ruled 
out, leaving only three states for the pair as indicated in the theorem. 

The results of this section are used in Chapter 6. 


PROBLEMS 


l. Put x = A*y in (4.9-1) to prove ||A*|| < |All. Put y = Ax to prove the 
reverse inequality. 

2. Verify (4.9-3), (4.9-4), and (4.9-5). 

3. Prove (4.9-6). Then use (4.9-5) to get (4.9-7). 

4. Let E be the operator defined in the problem at the end of § 4.82, and let 
F be the corresponding operator for Y. Show that A* = E-14'F. Use this 
to prove that the states of A* and A’ are the same. Notice that E and F are 
norm-preserving operators. 

5. 4(A) = Y if and only if A* has a continuous inverse. #(A*) = X if and 
only if A has a continuous inverse. 

6. Let X be a Banach space, and suppose A¢[X]. Then, there exists 
. Be [X] such that BA = J if and only if (a) A has a continuous inverse, and 
(b) there exists a continuous projection P of X onto A&A). If X is a complete 
inner-product space, (5) is satisfied whenever(a)is. Give details of the argument, 
noting that, if P is known, we can take B = A~'P and that, if B is known, we 
can take P = AB. 
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D 


SPECTRAL ANALYSIS 
OF 
LINEAR OPERATORS 


5.0 Introduction 


In this preliminary section we shall indicate the main trend of the 
ideas to be developed in this chapter. We consider a normed linear 
space X and a linear operator T whose domain A(T) and range A(T) lie 
in X. Then we consider the operator AJ — T, where A is a scalar para- 
meter and / is the identity operator. For convenience we usually suppress 
the J and write A — T' in place of AJ — T. 


Definition. If A is such that the range of A — T is dense in X and if 
A — T has a continuous inverse, we say that A is in the resolvent set of T; 
this set of values of à is denoted by p(T). All scalar values of A not in 
p(T) comprise the set called the spectrum of T; it is denoted by o(T). 


In a broad sense, spectral theory, or spectral analysis, of linear operators 
is the systematic study of the relations between the operators T, 
(A — T)-!, the sets p(T), o(T), and various other operators and linear 
manifolds which enter the picture naturally. 

If X is of finite dimension n and if Z(T) — X, we can represent T by 
an n x n matrix, say (¢,,); then A — T is also represented by a matrix, 
and o(7) is composed of those scalars à which are the roots of the equation 
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à — ty =g as — Éin 

i: Accu o|! — lon 
E y = 0. 

= fn À — fy wes À — tmn 


The determinant here is a polynomial of degree n in À. Hence, if the 
scalars associated with X are complex, then o(T) contains at least one 
point, and it may contain as many as, but not more than, z distinct points. 
If the scalar field is the real field, however, it may be that o(T) is empty. 
In spectral theory we usually deal with complex scalars, for by so doing 
we get a richer theory in which we can utilize much of the machinery of 
the classical theory of functions of a complex variable. 

For nearly all of the extensive developments of spectral theory we 
assume that X is complete and that T is closed. In this case, if A € p(T), 
the fact that A — T has a continuous inverse implies (see Theorem 4.2-E) 
that Z(A — T) is closed; since it is dense in X, it is all of X. Hence in 
this case, when A € p(T) the operator (A — T)-! belongs to [X]. It turns 
out that p(T) is an open set in the space of scalars and that (A — T)^! is 
developable as a power series in A — Ag about each point Aj € p(T). This 
power series has coefficients in [X], and it converges in the norm topology 
of the space of operators. Thus we can regard (A — T)-! as an analytic 
function defined on p(T), with values in [X]. This function is called the 
resolvent of T. Any point of o(T) which is a point of accumulation of 
p(T) may be regarded as a “singularity” of the resolvent. If the scalar 
field is complex, the relation between (A — T)-! and the spectrum can 
be investigated with the aid of contour integrals in the complex plane. 

In the finite-dimensional case, for instance, the spectrum consists of 
one or more isolated points each of which is, in a certain definite sense, 
a pole of (4 — T). By using the Laurent expansion of (A — T)! 
about each pole, we find certain projections, with the aid of which we 
express X as a direct sum of linearly independent subspaces, say 
X=M,@---@M,. These subspaces are invariant under T; that is, 
T(M;) € M;. Part of the interest of this decomposition of X as a direct 
sum lies in the fact that, when we restrict attention to T as it operates 
merely on the subspace M;, we find that its spectrum consists of a single 
point. If we choose a suitable basis for M;, the matrix representation of 
T takes on an especially simple form. In the general case (X not finite 
dimensional) matters are usually much more complicated, but the pattern 
of developments in the finite-dimensional case still indicates a certain 
direction for investigations. 
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Spectral theory includes the study of eigenvalue problems. If A is a 
scalar such that A — T has no inverse, this means that there is at least 
one nonzero vector x such that Tx = Ax. In this case A is called an 
eigenvalue of T, and x is a corresponding eigenvector. The null manifold 
of A — T is called the eigenmanifold corresponding to À. An eigenvalue 
of T is a point in the spectrum of T. In general, however, o(T) will 
contain points which are not eigenvalues. 

Certain parts of the classical theory of integral equations can be 
developed within the framework of abstract spectral theory. A Fredholm- 
type integral operator, acting in the space C[a, b], has certain special 
properties which can be described in terms which are meaningful in any 
Banach space, and it turns out that these properties furnish a basis for a 
general theory (the theory of compact operators) which includes important 
parts of the theory of Fredholm integral equations of the second kind. 

There are certain special features of great interest in the spectral 
analysis of linear operators in inner-product spaces; this is especially so 
for Hilbert spaces. The most highly developed spectral theory. is that 
for self-adjoint operators, which are in a certain sense like operators T 
in /2(n) which are represented by matrices (¢;;) with Hermitian symmetry: 
tj = lj. For the finite-dimensional case of the space /?(n) the dominant 
fact about such operators is that there is a certain orthonormal basis for 
the space such that the matrix representation of the operator takes the 
form l 


à 0 - o0 
0 A% 
ES 


where A, ---, A, are the points (not necessarily all distinct) forming the 
spectrum of the operator. The basis vectors in this case dre eigenvectors, 
and /2(n) is the direct. sum of eigenmanifolds corresponding to distinct 
eigenvalues. The appropriate generalization of these things for operators 
in Hilbert space is taken up in Chapter 6. 

The main theorems on the spectrum and the resolvent of a linear 
operator are 5.1-B, 5.1-C, 5.2~A, 5.2-B and 5.2-E. The principal 
theorems in the spectral theory of compact operators are 5.5-F, 5.5-G, 
5.5-H, and 5.5-I. Section 5.5 concludes with a summary of applications 
of the theory of compact operators to the study of integral equations of 
the second kind. In the latter part of the chapter, where the spectral 
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analysis is carried on by means of the operational calculus founded on 
contour integrals, the principal theorems are 5.6-A, 5.7-A, 5.71-A, 
5.8-A, and 5.8- B. 


5.1 The Resolvent Operator 


Once and for all we assume, in this chapter, that X is a normed linear 
space which contains some nonzero elements. The scalar field may be 
either real or complex, except as explicitly stated otherwise. 

If T is a linear operator with domain and range in X, we adopt the 
following notations as a convenience in stating some of the next few 
theorems: 

T,=A-T, a = range of T), 


M(A) = norm of T,~! as an operator on &, if T,~! exists and is continuous. 
Our first fundamental results are as follows: 


Theorem 5.1-A. Suppose u is such that u — T has a continuous 
inverse. Then A — T has a continuous inverse if |à — u|M(u) < 1. 


Moreover, 2», is not a proper subset of &,,. 
PROOF. Supposexc€ HT). Then Tax = Ax — Tx = (A — p)x + T,X, 
and so 
Dx > Tx — JÀ — pl lxi. 


Now ||x|| = |T, T,x| < M(p)iT,x|. Therefore 
MWIN > MJIT, x| — |A — e| MGOlxI 
> {1 — JA — uMGJIlIxI. 


Because of the inequality assumed in the theorem, this last inequality 
shows that x = 0 if T,x = 0; hence T,~! exists. If we write y = Tx, or 
x = T,~!y, we see that 


| Mly 
(5.1-1) WE S T (pay 


This shows that T,-! is continuous. To prove that Z, is not a proper 
subset of a, assume the contrary. If is chosen so that |À — u|M(p) < 
0 « 1, there must exist an element yo eg, such that ||yol| = 1 and 
ly — voll > 8 if y € Z, (by Theorem 3.12-E). Now choose y, € 2, so 
that y, — yo. Let x, = T yy, y, = T,x, Then Tx, = (A — i)x, + 
T,x,, whence E 


T,X, — Tx = |A — | Ix < [A — e MOI uU. 
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But 74x, € A), and so 


8 < yo — Tax,l| < liyo — Tuxsl + lT xs — Taal, 
or 


8 < [yo — Yall + [À — n MDYa 


If we now let 1 — oo we obtain the contradiction 0 < |À — p|M(p). 
This finishes the proof. 


Theorem 5.I-B. The resolvent set p(T) is open, and hence the spectrum 
o(T) is closed. 


PROOF. If un € p(T), T,-! exists and is continuous, and #, = X. 
Theorem 5.1—-A shows that, if A is sufficiently near u, then 7^! also exists 
and is continuous, and Z, is not a proper subset of X. Hence Z, = X. 
Then A € p(T). 

It was noted in $ 5.0 that, if X is complete and 7'is closed, the range 
of A — Tis all of X when Ae p(T). For certain results about the inverse 
operator T,-! we shall assume directly that 2, = X when A € p(T), since 
this is the essential condition for obtaining these results. When A € p(T), 
we shall regularly denote 7,-! by R,; as stated in § 5.0, R, is called the 
resolvent operator (of T). The following theorem is of fundamental 
importance. 


Theorem 5.|-C. Suppose T is such that Z, = X if `€ p(T). Then, 
if à and y are any two points in p(T), R, and R, satisfy the relations 
(5.1-2) R, — R, = (k — MRR, 

(5.1-3) RR, = RR. 
If u € p(T) and |p — À| \|R,|| < 1, then à € p(T) and 


(5.1-4) R= (p — APRES, 
0 


the series converging according to the metric in [X]. As a function on 
p(T) to [X], R, has derivatives of all orders, with 
dn n n+ 

(5.1-5) do ^ mE (— 1) n! R*+ . 

PROOF. To prove (5.1-2), suppose y € X and x = R,y,sothat y = T,x. 
Then, since 

Tux — Tx = ux — Tx — (Ax — Tx) = (p — Xx, 
we have 
y — T4R,y = (9 — 39R,y. 


258 INTRODUCTION TO FUNCTIONAL ANALYSIS [$5.1 
Hence, applying R, to both sides, we obtain 


Ry — Ry = (e — ARR. 


This proves (5.1-2). By symmetry the result holds with A and p 
exchanged; from this we conclude that (5.1-3) holds. 

We know from Theorem 5.1-A that u € p(T) and Jà — «| [RJ] < 1 
imply à € p(T). To prove (5.1-4) with this condition on A and » we use 
(5.1-2), (5.1-3), and induction to prove that 


Ry = > (u — NER + (a — AYHRIR, 
k=0 


ifn 20. Thus (5.1-4) is equivalent to 


(5.1-6) lim |u — Alr+1|RE+1R,|| = 0. 


Since ||R"*'R,|| < [R^ *!] AR), and |u — Al IR, < 1, we see that (5.1-6) 
is true. 

To prove (5.1-5) when n = 1, perhaps the easiest method is to start 
with (5.1-2) and show that 


(Ra — RDA — p) + RA = I — ARRAI S JA — el Roll TRI. 
Then, from (5.1-1) we see that when |À — p| is sufficiently small 
[RAE < WRG — [A — el IRD. 


Hence (R, — R,)/(A — y) > — R,? as A—> p. For higher values of n, 
(5.1-5) may be proved by induction. See problem 2. 

If à — T has a continuous inverse, À need not be in p(T), for the range 
of à — T may not be dense in X (for an example see problem 4). The 
following theorem tells us that, if T is closed and X is complete, such a 
value of À must be at a positive distance from p(T). 


Theorem 5.I-D. Suppose that X is complete and that T is closed. 
Suppose » — T has a continuous inverse and that p € p(T). Then p € p(T). 


PROOF. Choose A,€ p(T) so that A,— u. For convenience let A, 
denote R, when A = A... We know that Z, = X when Ae p(T). Hence, 
by (5.1-2), 


It follows from (5.1-1) that |[4,|| is bounded as n — oo. Hence, since 
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[X] is complete, we see that there exists some A€ [X] such that 
(4, — Al| 0. If Ae p(T) we have 


EP EJ Ry = (à ax A)R Ans 
and so 
(5.1-7) A — R, + (à — p)R,A. 


This shows that the range of A lies in the range of R,, which is Z(T). 
We shall show that T, Ay = y if y € X, thus proving that the range of T, 
is all of X, whence u € p(T). Now, if A € p(T), 


(5.1-8) T,Ay = (u — AAy + T, Ay. 


By (5.1-7) we have T,Ay = y + (A — »)Ay. When this is substituted in 
(5.1-8) we obtain T,Ay = y, and the proof is finished. 


PROBLEMS 


I. Prove that M(A) is continuous on the open set of values of A for which 
A — T has a continuous inverse. Hint: use (5.1-1) and show that, if A and u 
are in the open set referred to and |À — p| is sufficiently small, then 


Miu) Mw) 
Te - apii € 49 <i uM) 


2. To complete the proof of (5.1-5) by induction it suffices to prove that 
(d/dA)R," = — nR**!, Do this (at A = p) by factoring Ry" — R,”. 

3. Suppose that, for each A in a nonempty set S of scalars, A, is a linear 
operator on X into X such that A, — A, = (u — A)A,A, if à p ES. Suppose 
also that 4, ! exists for at least one A € S. Show that Ax! exists for every 
à e S, that all the operators A, have the same range 2, and that there exists a 
linear operator T on 2 into X such that A — T = Ay! foreach Ae S. Show 
further that, if A, is closed for at least one A, then T is closed and A, is closed 
for every à e€ S. 


4. Consider the operator Te[/!] defined by y = Tx, where y» = {ną}, 
x = (£i, 9 = 0, and ng = — £j, if k > 2. Show that (A — T)! exists for 
all A, that p(T) consists of all À for which |À] > 1, and that ||Ryll = ({A| — D. 
Use problem 5, 84.51. If |A| < 1 the range of À — T is not dense in /!. The 
inverse is continuous if |A| < 1, but not if [A] = 1. 

5. Let X be the completion of X (X itself if X is complete). Assume p(T) 
not empty, and for each A € p(T) let A, be the unique extension of 73^! to all 
of f. Show that 4, — 4, = (u — A)A,A, if A and p are in p(T). We shall 
say here that T has a closed linear extension if there exists a closed linear oper- 
ator 7), with domain and range in Y, which is an extension of T. Show that 
such a closed linear extension exists if and only if 4, has an inverse for some 
A € p(T) (and hence for all such A, by problem 3). The next problem shows that 
T' can fail to have a closed linear extension. 
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6. Take X = 1). Let Z(T) be the set of x = (£,) such that £, = 0 except for 


a 

a finite number of indices. Define Tx = y by y, = k? 5 PE. Then T 
i-k 

defines a one-to-one mapping of Z(T) onto itself; T^! is continuous and T is 

discontinuous. The extension A of T7! to all of X is defined by Ay = x, where 

K?*£, = km, — (k + 1)?g44,. But A has no inverse. Hence T has no closed 

linear extension (see problem 5). 


7. Let T be a linear operator with domain and range in X (not necessarily 
complete). Let G be the graph of T and G the closure of G (in the product 
space X x X). If there is some closed linear operator Tọ with domain and 
range in X, such that Tọ is an extension of T, then G is the graph of a uniquely 
defined “minimal” closed extension of T, which we denote by 7; 2(T) and 
A(T) are dense in 2(T) and #(T), respectively. If X is complete and T is 

continuous on 2(T), G is the graph of an operator 7 which is continuous, with 
2(T) = ZT). 

8. If X is complete and if T has a closed linear extension, the operator T 
(see problem 7) has the same resolvent set and spectrum as 7. 


5.2 The Spectrum of a Bounded Linear Operator 


In all of the theorems of this section we assume that Te [XY]. The 
main results are concerned with the finding of the smallest constant r 
such that |A| <r if Ae c(T), and with the expression of (A — T)! in 
terms of A and T when |A| » r. 


Theorem 5.2-A. /f Te[X] and |A| > [|T|, (A — T)-! exists and is 
continuous, and 


5.2-1) (A - T) = > AcnTh-ly 
1 


for each y in the range of À — T. If X is complete, |A| > |T|| implies 
AE p(T), and then 


(5.2-2) A-T = R = Done. 
the series converging in the space [X]. 
PROOF. If|A| > |T], we have ` 
[Ax — Txl > |A| x — Zx 2 CA] — T lis. 


The existence and continuity of (A — T )! now follows by Theorem 
3.1-B. If y = (A — T)x, we find by induction that 


x= Avly +. F AT" iy + A7"T"x. 
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Formula (5.2-1) follows from this, because A-"7*x — 0 when |A| > ||T ||. 
The assertion about (5.2-2), when X is complete, follows by taking 
A = AT in Theorem 4.1-C. 

We see from Theorem 5.2-A that, when X is complete, A € o(T) implies 
[A| € IT]. Since o(T) is closed, this shows that o(7) is compact when 
Te[X] and X is complete. If we are given some compact set, there is 
some bounded linear operator having this compact set as its spectrum. 
See problem 1. 

Before going further we note this useful fact: Jf T € [X] and if the 


series 2 A-^T"-1 converges in [X] for some value of ^, then à € p(T) and 
1 


the operator defined by the series is R,. For, denoting the series by A, it 
is easily seen that (4 — T)A = A(A — T) = I. 

. For the remainder of this section we need to assume that X is a complex 
Banach space. The reasons for this are not superficial. We need the 
theory of analytic functions of a complex variable, with values in [X]. 
We cannot relate the convergence of the series (5.2-2) to the extent of 
the set p(T) unless we think of A as a complex variable, for somewhat the 
same reason that the radius of convergence of the power series expansion 
of a real analytic function cannot be discovered merely by looking for 
singularities of the function on the real axis. 

In $8 4.4 and 4.42 we commented on the concept of an analytic function 
of a complex variable with values in a complex Banach space. We must 
now make some use of the theory of such functions. A great deal of the 
standard classical theory can be taken over intact, proofs and all. 
Cauchy's integral theorem, the integral formulas for a function and its 
derivatives, Taylor's theorem, Laurent's theorem, Liouville's theorem, 
and many other theorems retain their validity. The proofs are just as in 
classical theory, except that norms replace absolute values. Some 
further discussion of these matters is indicated in the problems. For our 
immediate purposes we need the theorems of Liouville and Laurent. 

The key fact is that, when T is closed and X is a complex Banach space, 
R, depends analytically on A as A varies in p(T). This is true by Theorem 
5.1-C. 


Theorem 5.2-B. /f Te [X] and X is a complex Banach space, o(T) 
is not empty. 


PROOF. It appears from the proof of Theorem 5.2-A that ||R,|| < 
- (A1 — |Z) if [A] > ITI]. Hence ||R,|| — 0 as |A| > œ. If o(7) were 
empty, it would follow that R, is analytic and bounded on the whole plane. 
But then it would be constant, by Liouville’s theorem, and the constant 
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would be the zero operator. This is impossible, by the fact that R, sets 
up a one-to-one mapping of X onto itself, for X is assumed to have some 
nonzero elements (see the beginning of § 5.1). 

Theorem 5.2-B remains valid even if X is not complete, as may be 
shown by an argument involving the completion £ and an extension of 
the operator. See problem 2. 


Definition. Supposing c(T) nonempty and bounded, we define 
(5.2-3) r(T) = sup |Al, 
Aec(T) 


and call r,(T) the spectral radius of T. 


Theorem 5.2-C. Jf Te[X] and X is a complex Banach space, the 
resolvent is given by 


(5.2-4) R, = nma 
2 


if |A| > FAT). This series also represents R, if the series converges and 
JA] = r(T). The series diverges if |À| < rT). 


PROOF. We know that R, is analytic when |A| > r,(T). Hence it has 
a unique Laurent expansion in positive and negative powers of A, con- 
vergent when [à| > r,(T). Now, we already know that (5.2-4) is valid 
when |A| > ||T|. By the uniqueness, then, this must be the Laurent 
expansion (it may also be called the Taylor expansion about the point 
A = oo) The second assertion in the theorem follows from the italicized 
statement in the second paragraph after the proof of Theorem 5.2-A. 
For the same reason, the series (5.2-4) cannot converge if A €o(T). 
Hence it cannot converge at Ag if |Ao| < r,(T), because, if it did, it would 
follow, as in the general theory of power series, that the series converges 
when |A| > |Aol, and so, in particular, for some A € o(T). 

Theorem 5.2-C enables us to write a formula for the spectral radius 
of T. If we consider the series (5.2-4) as a power series in A-!, the 
standard formula for the radius of convergence of a power series tells us 
that 


(5.2-5) r(T) = lim sup |[T"j|U^. 


Actually, as we shall presently prove, {||7”||!/"} is a convergent sequence, 
so that the limit superior in (5.2-5) is a limit. To prove this, we first 
prove what is called the spectral-mapping theorem for polynomials. 
Suppose 


F(A) = a a 4T B + o. 
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is a polynomial with complex coefficients. If T € [X], positive integral 
powers of T have a clear meaning, and we define 


F(T) = aT” + a, T" ec Cla 


By the rules of algebra for operators it is clear that, if the polynomial 
F(A) is factored, there is a corresponding factored form of F(T). 
Now F(T) € [X], and we can consider its spectrum. 


Theorem 5.2-D. Suppose Te[X], where X is a complex Banach 
space. If F is a polynomial, the spectrum of F(T) consists precisely of 
those points u such that F(A) = u for some X€o(T). In symbolic form, 
o{F(T)} = F{o(T)}. 


PROOF. We can assume that n > ] and a, = 1, leaving the case n = 0 
to the reader. For a fixed u let the zeros of F(A) — p be B,, - - -, Bn, so that 


(5.2-6) - F(T) — pl = (T — B)::- (T — Bj). 


ICT — Bi ++, T — B, each have continuous inverses defined on all of 
X, so does F(T) — pl, the inverse of the latter being the product of the 
inverses of the former in the reverse order. Hence, if u € o(F(T)), there 
must be some f, such that £, € o(T). Since F(B,) = p, this shows that 
o{F(T)} € F{o(T)}. Suppose, on the other hand, that some $}, say fi, 
is in o(T). If T — f, has an inverse, the range of T — f; is not all of 
X, and (5.2-6) shows that the range of F(T) — pi is likewise not all of 
X; hence u € o{F(T)}. If T — f, has no inverse, we see by exchanging 
the positions of the factors T — 8, and T — f, in (5.2-6) that F(T) — pl 
also has no inverse, and again p € e(F(T)j. This argument works just 
as well for any f, as for 8,, and so the proof is complete. 


Theorem 5.2-E. Suppose T € [X], where X is a complex Banach space. 
Then r(T) < ||T"||V" for every positive integer n. Also, ||T*|\'" converges 
to r(T) as n — oo. 


PROOF. Theorem 5.2-D shows that o(7") consists of the ntt powers of 
points of o(T). Hence r,(T*) = [r.(T)l. We know (Theorem 5.2-A) 
that r.(T") < IT”. Hence r,(7) < |T". It follows that 


r(T) < lim inf ||T"||U/. 
n> 
This, together with (5.2-5), leads to the final conclusion of the theorem. 


PROBLEMS 


I. Let S be a compact set in the plane. Let (o) be a sequence of points of 
S everywhere dense in S. Define Te[/?] by Tx = y, where x = {€,}, 
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y = {a,€,}. Then S = o(T). Each c, is an eigenvalue; for the other points 
à e S, the range of A — T is dense in /? and the inverse is discontinuous. 

2. To prove Theorem 5.2-B when X is incomplete, let 7? be the unique linear 
extension of T to all of the completion X. Prove that p(T) C. p(T), and hence 
o(f) € o(T), in two steps: (a) if A € p(T), A — f has an inverse; (b) the range of 
À — ff is all of X, and hence the inverse is continuous. 

3. Instead of proving theorems about Banach-space-valued analytic functions 
by repeating the classical proofs, it is sometimes possible to make use of linear 
functionals. For instance, to prove Liouville's theorem, assume that f, with 
values in X, is differentiable at all points of the complex plane and bounded. 
Then x’[f(A)] is a scalar-valued function with the same properties, for each 
x’ € X' and is therefore constant. Thus x’[f(A) — f(0)] = 0 for each x’ and 
each A. But then f(A) = f(0). Cauchy's theorem may be proved in a similar 


way, by noting that zu fA) a} E [ x’ Lf] da. 
[s C 


4. If X = C[a, b] and T is a Volterra-type integral operator (see § 4.11), 
o(T) is the single point A = 0. 

5. If T does not belong to [X], o(7) may not be compact. Example 3, § 1.5 
illustrates a situation in which the spectrum of a certain differential operator 
consists of the points — n?, n = 0, 1, 2, ---. Example 4, 8 1.5 shows a differ- 
ential operator whose spectrum is composed of all A whose real part is < 0. 

6. Suppose 4, B, Ce[X], A 0, and C(À — BA) = (à — BA)C= I. Let 
D=! + AUGACB. Then D(A — AB) = (à — AB)D = I. Thus, when X is 
complete, the nonzero points of p(AB) and p(BA) are the same. Hence 4B 
and BA have the same spectral radius. 


7. If X is a complex Banach space and AB = BA, where A and B are in 
[X], then r,(AB) < r,(A)r,(B). 

8. Suppose 4 € [X], A" z 0 for all n, and let Anil’ be monotonic in n. 
Show that |A7*1i/iL4"l| < 14^)1/7, whence it can be inferred that lim (1147* 1/47) 
= lim |4^|/7, For a case in which ||A”'!/" is not monotone, let A e [/!] be 
defined by Ax = y, where n= 0, No = 2T 72k] = 2£, kz-41,2,:- 


5.3 Subdivisions of the Spectrum 


We can classify the various values of the parameter A according to the 
state of the operator A — T, using the definitions of "states" as made in 
84.71. We say that A is in one of the classes Ij, Ip, ---, I, III, if 
à — T is in the corresponding state, as an operator on Z(T) into X. 
For this classification we do not insist that T be continuous or even 
closed. According to the definitions, A € p(T) if and only if A is in class 
I,orli, It has been customary to group the remaining classes as follows, 
thus dividing the spectrum into three mutually exclusive parts: 


Classes I; and II; = the continuous spectrum, denoted by Co(T); 
Classes III, and III; = the residual spectrum, denoted by Ro(T); 
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Classes I}, II}, and III, = the point spectrum (eigenvalues), denoted by 
Po(T). 


When T'€[X] the operator T’ is defined, and (à - T) = A — T". 
The results of $ 4.71, and the state diagram in particular, can be applied 
to show exactly how the classification of A in relation to T affects its 
classification in relation to T’, and vice versa. We note the following 
result: 


Theorem 5.3-A. If T € [X], then T and T’ have the same resolvent set 
and the same spectrum. 


For illustrative purposes we shall discuss two operators, each of which 
may be considered as a bounded operator on /? into /? for any selected 
value of p, 1 < p < œ. We shall analyze the spectrum of each operator 
and see how the resulting classification of each spectral value A depends 
on the value of p. Some of the details are left for the problems. We 
always write x = (£y = (gh no102,:--. 


Example I. Let T on F into /? be defined by the infinite matrix 


01000 
00100 
00010 


so that (A — T)x = y means ną = M, — Ek} k = 1,2, -+ It is easy 
to see that ||T|| = 1 for each value of p. Hence |A| > 1 implies A € p(T). 
It is readily seen that when p = oo and |A| < 1, A is an eigenvalue; the 
corresponding eigenmanifold is generated by the vector (1, A, A2, ---), 
When 1 < p < œ we have this same eigenvalue and eigenmanifold if 
[A] < 1. But (à — T)! exists if |A| = 1 and 1 < p < œ, for (I, A, 
A2, - - -) is not an element of /? in this case. Since o(7) is closed, we see 
that, for each value of p, o(T) is the set (4:|A] < 1}. When |A| = 1 and 
1 € p < œ, the inverse cannot be continuous, by Theorem 5.1-D. 

To investigate the range of à— T we find by induction from 
Mk = M — Eua that 


Ena = ARE, — Akin — AK 2g — e — ny 
and that 


& = yy tives + AX + AE ee if A SEO. 


Note that A-ké,,,; — 0 ask — oo if |A| > 1 and 1 <p « ooorif]A| > 1 
and p = oo. This enables us to find x in terms of y when y = (A — T)x. 
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In particular, we get the formulas for the resolvent operator when 
jA] > 1. When |A| = 1 and 1 < p < œ, the range of A — T is dense in 
Ir, for it is easily seen to contain y if the number of nonzero components 
of y is finite. The range cannot be all of /? in this case, however. Why 
not? We leave it until later to show that the range is not dense in /? 
for the case |À| = 1 and p = œ. When A = 0, the range of A— T is 
obviously all of /?, for each p. When 0 < |A| < I and y is in the range 
of A — T, any x such that (A — T)x = y is given by x = &j(1, À, 32, ++} — 
A~!z, where z = (£,), 6 = 0, and 


(5.3-1) beat = qp + MWg eos p fkl. 


After discussing Example 2 we shall see that the range of A — T is all 
of lr in this case, for each p. 


Example 2. Let A on I? into /? be defined by the infinite matrix 


0 
0 
1 
0 


ooceo 


0 
I 
0 
0 


_rFoce 


This is the transpose of the matrix of Example 1. When p = œ, A can 
be identified with the conjugate operator 7", T being the operator of 
Example 1, with p = 1. Ifl « p « oo and p' = p/(p — 1), A for p' can 
be identified with the conjugate T’ of T for p. Finally, T for p = oo can 
be identified with the conjugate A’ of A for p = 1. These remarks, and 
the state diagram of § 4.71, will help us in analyzing the spectrum of A. 
In particular, the relations between an operator and its conjugate assure 
us that || 4| = 1 (which we can of course see directly) and that o(A) = o(T) 
= {A:|A| < 1}. 

The equation (A — A)x = y is expressed by the equations y, = Ag;, 


Neri = — ék Mau, k > 1. When A = 0 we see that the inverse of 
A — A exists and is continuous, for ||Ax|| = ||x||. The range is not dense 
in /», however, for y = — Ax implies », = 0; the range is a proper closed 


subspace of łe. When A z 0 the inverse of A — A exists; x = (A — A)~1y, 
for y in the range of A — A, is expressed by 


(5.3-2) bx = ATEN + Alina +- + AT ly. 


In particular, these equations define the resolvent of A when |A| > I. 
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We can use equations (5.3-2) in discussing the range of A — T. A 
“scrutiny of (5.3-1) and (5.3-2) shows that the z of (5.3-1) can be written 
in the form z = A(A~! — A)-ly. The solutions of (A — T)x = y are then 
x = €(1, A, X, <.) — A-1A(A-1 — A)-1y, where ¿į is arbitrary. If 
0 < |A| < 1, this formula is applicable for every y in /?, for all p, and so 
we see that the range of A — T is all of X in this case. The result is valid 
for 0 < || < 1 if we write it in the form x = é(l, A, M, -.) + 
AQAA — Dy. 

Next we show that, for p = oo, the range of A — A is not dense in /^ 
if [A| = 1. In fact, we show that y is not in the range if |y ~ wl] = e < 1, 
where w = (!, A2, A3, ..-) If we assume that xe/™ and 
(A — A)x = y, we can write y = w + (05, 92, - - ), where |0,| < e, and 
we have, from (5.3-2), 


= nàni 4 A7n-1(A8, + A?0, Te Ana), 
so that 
[alé — Aon1| = n71|A0, +--+ Y, S e. 


Letting n — oo, we obtain the contradiction 1 < e. 

An argument of a similar kind will show for the case p = œ, |A| = 1, 
that the range of A — T is not dense in /?. If y = (A — T)x, it may be 
verified that y = (M£,, 0, 0, ---) — (à-1 — A)T(Ax), and from this it may 
be shown that y is not in the range of A — T if ||y — w|| = e < 1, where 
w = (A, A2, A3, eo). 

It is now possible to make a complete classification of the points of 
the spectra of T and A for all values of p. See the problems. 


PROBLEMS 


l. For the T of Example 1 there is the following classification of points of 
o(T). (@ à= 0:h; (b) 0 < JA] < 1:2; (© [Al = 1:1; if 1 < p « o, and 
III; if p = œ. 

2. For the A of Example 2 there is the following classification of points of 
o(A). (a) |A| < 1:01; (b) |À| = 1: if 1 « p < oo, and III; if p = 1 or oc. 
Some of these results are obtained by using problem 1 and the state diagram. 

3. When p = 1 and 0 < |A| < 1 in Example 2, show that |(A — A)xl| > 
(1 — |AD/ixll, so that (A — Ay! is continuous. 

4. If (A — A)x = y in Example 2, show that nı + Ano +--+ + Mg = 
Ak+1é,.1, This may be used to show that the range of A — A is not dense in 
lr if ||| < Land p = œ, or if |À| < 1 and p = I. 

5. If |A| = L and 1 < p < œ in Example 2, take x, = (1, A}, - - -, A177, 0, 0, 
+++), and show that (A — A)! is not continuous. 
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6. Let ai, «2, +++ be scalars such that sup |aj| < oo. Let Bo, B, --- be 
k 


[ve] 


[^] 

scalars such that > IBul < o. Define Te [/] by y, = > ug ne = Bee, if 
2 1 

k z 2. Discuss o(7) and find the resolvent operator. 


7. Let T € [/!] be defined by the infinite matrix 
0 1 1! 


1 
1 0 0 0 
0 1 0 0 
0 0 i Q 


Show that o(T) consists of A = (1 + /5)/2 and all A such that |A| < 1. 
Classify the points of c(T). This operator has an interesting connection with 
the Fibonacci numbers, as may be seen by computing the matrix representation 
of T^. The operator has been studied by Halberg, 1, pages 21-29. 

8. The operator A € [/!] defined by the matrix («;j) with oj; = Lif |i — j| = 1, 
oj; = 0 otherwise, is interesting. Its spectrum consists of the interval 
— 2 < à < 2 of the real axis. The points A = + 2 are classified IL; the rest 
of o(A) is classified HI, (see Halberg, 1, pages 29-36). We may also consider 
A as an element of [/?]. The spectrum is the same as before, but now all points 
are classified I], (Hellinger, 1, pages 231—232). 


5.4 Reducibility 


Let T be a linear operator with domain and range in the linear space 
X. For convenience we shall sometimes write 2 instead of Z(T) for 
the domain of T. A subspace M of X is said to be invariant under T if 
T( ^ M) € M. We can then talk about the restriction of T to M, 
with M in place of X and ZN M in place of 2. 


Definition. The operator T is said to be completely reduced by the 
pair of subspaces (Mi, M2) if these subspaces are linearly independent 
(see § 4.8) and invariant under T, such that X = M, ®© M; and such that 
P,Z c 9 (i= 1, 2), where P, and P, are the projections defined by 
Pjx = xj, where x = x, + x; (x; € Mj) is the direct sum representation of 
an arbitrary x. 


This definition can be extended in an obvious manner to give meaning 
to the statement “T is completely reduced by the set of subspaces Mj, 
o, MT 

Let us see the meaning of the foregoing concepts in terms of the matrix 
representation of T when X is n-dimensional and 2 = X. Suppose that 
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M, is r-dimensional (1 < r < n), and let us choose a basis for X such 
that the first r elements of the basis form a basis for M,. Then, if Mi 
is invariant under T, the matrix which represents T will have all zero 
elements in the intersection of the first r columns and the last n — r rows. 
If M; is the subspace generated by the last n — r basis elements and if T 
is completely reduced by (M,, M2), all of the elements in the intersection 
of the first r rows and the last n — r columns will also be zeros. 

If an operator is completely reduced by a pair of subspaces, the operator 
may be studied by studying the restrictions of it to these subspaces. If 
these restrictions can also be completely reduced, the study of the 
operator may be simplified further. Evidently, if X is n-dimensional and 
2 = X, the greatest simplification will occur if we can find a set of n 
subspaces M,,---, M,, each of them one dimensional, which completely 
reduce the operator. This is the same as asking that X have a basis 
uj, coc, Up, each element of which is an eigenvector. The matrix 
representing the operator will then have eigenvalues down its main 
diagonal, and all other elements will be zero. This situation can occur 
only for operators of a very special sort. 

We are speaking here of finite sets of subspaces which completely 
reduce an operator. There are important generalizations of this concept 
for infinite sets of subspaces. For the present we do not try to develop 
such generalizations, but we mention the following concrete example. 

Let X = L2(0, 27). Let 2 be the subspace of X determined by those 
functions x(r) in .Z2(0, 27) which are absolutely continuous on (0, 27] 
and are such that x(0) = x(27) and such that the derivative x’(z) is also 
in .Z2(0, 27). We then define Tx = y, where y(t) = x(t). Let u,(t) = 
(1/V2z)ei", n 20, +1, € 2, --- The us form a complete ortho- 
normalsetin X. Observe that u, € Z and that the closed linear manifold 
generated by each u, is invariant under 7; the same is true of the closed 
linear manifold generated by any finite or infinite subset of the u,'s. 
Hence T is completely reduced by (M, M+), where M is the closed linear 
manifold generated by any set oftheu,'s Ina certain.sense T'is completely 
reduced by the infinite set of subspaces {M,}, where M, is generated 
by ün 

If X = M, Q M, and if P,, P; are the projections determined by this 
direct sum representation of X, an operator T with domain 2 is completely 
reduced by (Mj, M;) if and only if P,Z c 2 and P,Tx = TP,x when 
x€4. The corresponding conditions will then be satisfied by P}. The 
simple verification of these assertions is left to the reader. It is then 
easily proved that, if T is completely reduced by (Mı, M2) and if T! 
exists, then T~1 also is completely reduced by (Mi, M2). 

For formal reference we now state several theorems. 
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Theorem 5.4-A. Let T be completely reduced by (Mı, M;). Let T, 
be the restriction of T to M,. Then (a) 9(T) = 2T) ® Z(T;); 
(b) AT) = RT) D 2(T5); (c) T- exists if and only if Ti^! and Tz) 
exist; (d) A(T) = X if and only if R(T) = My, for k = Y and 2. 


The proof is left to the reader. 


Theorem 5.4-B. Consider the situation of Theorem 5.4-A, supposing 
now that X is a normed linear space and that the projections P,, P, deter- 
mined by the direct sum X = M, ® M; are continuous. Then A(T) is 
dense in X if and only if A(T,) and A(T) are dense in M, and M, 
respectively. If T- exists, it is continuous if and only if T, and Ty! 
are continuous. 


The proof is left to the reader. We remark that P, and P» will certainly 
be continuous if X is complete and M, and M, are closed; see problem 2, 
§ 4.8. . 

When the conditions of Theorems 5.4-A and 5.4-B are satisfied, we 
can rephrase most of the results of these theorems as follows, using the 
terminology of § 4.71 regarding the classifications I, II, IH and 1, 2, 3: 


T is classified as | if and only if T, and T, are both classified as 1. 
T is classified as I if and only if T; and T, are both classified as I. 
T is classified as 3 if and only if at least one of Tj, T; is classified as 3. 
T is classified as III if and only if at least one of 73, T; is classified as III. 


From these statements, as applied to A — 7, which is completely reduced 
by (Mj, M2) if T is, we have the following theorem, verification of which 
is left to the reader. 


Theorem 5.4-C. Under the conditions of Theorem 5.4-B we have 


a. o(T) = o(Ti) U o(T)). 
b. Po(T) = Po(T;) Y Po(T)). 


If it is furthermore assumed that o(T,) and o(T2) have no points in common, 
it follows that 


c. Co(T) = Co(T)) U Co(T>) 
and 
d. Ro(T) = Ro(T,) V Re(T;). 


PROBLEMS 


I. Verify the assertions made in the paragraph immediately before Theorem 
5.4-A. 
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2. Write out the proofs of Theorems 5.4-A and 5.4-B. 
3. Write out the proof of Theorem 5.4-C. 


4. If Te[X], where X is a normed linear space, if T is completely reduced 
by (Mı, M5), and if the corresponding projections P,, P, are continuous, then 
T’ is completely reduced by (M49, M>°). See problem 4, 8 4.8. 


5.41 The Ascent and Descent of an Operator 


In this section X denotes a linear space, and T'is a linear operator with 
Z(T) and A(T) in X. The considerations are all algebraic. We define 
T" by induction, with T? = I, T! = T. If n > 1, A(T) is the set of x 
such that x, Tx,---, T"-!1x are allin Z(T). If n > 2, BT") = {x:x and 
Tx are in 2(7^-!)). For convenience we write Z(T") = Z,(T); observe 
that Z(T) = X. In general we have Z,(T) € Z,-,(T); the inclusion 
may be proper. 

We generalize a previous notation and terminology by defining the 
null manifold of T” as the set of x € Z,(T) such that T"x = 0. We denote 
this subspace of X by (T^). Evidently (T° = (0). 


Theorem 5.4l-A. N(T) c (T, n 20, 1. If (T9) = 
N (T+) for some k, then .W(T*) = .W(T») when n > k. 


PROOF. The first statement is evident. Suppose that (Tv) = 
(T^^!) for some n and that x e ./(T^*2. Then x€2,,;(T) and 
T"2x = 0. Hence Tx€Z2,,,(T) and T"*(Tx)—0, so that Txe 
MT!) = N(T*), Then 7(Tx) = Tr*!x =0. This shows that 
(T^*2) c W(T**!). The reverse inclusion also holds, and so 
AM(Tn*Y) = W(T*2), The second assertion of the theorem now follows 
by induction. 


Definition. If there is some integer n > 0 such that W(T*) = 
M'(T^*Y), the smallest such integer is called the ascent of T and denoted 
by «(T). If no such integer exists we say that a(T) = oo. 


Next we consider the ranges A(T"). Note that A(T) = X. 


Theorem 5.41-B. Z(T"))c R(T”), n=0, 1, ++ If A(T) = 
A(T*) for some k, then R(T) = 2(T*) whenn 2 k. - 


PROOF. If yeA(T**), y=T+1x, where x€2,4(T) Then 
Tx€Z,(T) and y = T(Tx), so that y € A(T"). This proves the first 
statement. Before proving the next assertion we observe that 


(5.41-1) RT) = T((T) ^ Z(T), n-01,2,-. 


272 INTRODUCTION TO FUNCTIONAL ANALYSIS (6$ 5.41 


Now suppose that &@(T*+!) = A(T") for some n, and suppose 
y E R(T"+1). By (5.41-1) we can write y = Tx, where x € A(T") O 2(T) 
= R(T") A 2(T). Thus, again by (5.41-1), y € Z(T"*?). This shows 
that Z(T»*!) C Z(T^"*2), and the proof is finished just as in the case of 
the previous theorem. 


Definition. If there is some integer n > 0 such that Z(T"*!) = Z(T»), 
the smallest such integer is called the descent of T and denoted by 8(T). 
If there is no such integer, we say that 8(T) = oo. 


Observe that «(T) = 0 if and only if T-! exists and that 9(T) = 0 if 
and only if (T) = X. 


There are certain relations between the ascent and descent of an 
operator, provided that certain auxiliary conditions are satisfied. 


Theorem 5.4l-C. If «(T) is finite and 8(T) = 0, then oT) = 0 also. 


PROOF. Suppose that 0 < o(T) and 3(T) = 0. Then A(T) = X and 
T-! does not exist. Choose x, # 0 so that Tx, = 0. By induction we 
define x2, x3, -- - so that x„+1 € Z(T) and Tx,4, = x,. Then we see that 
X44 € Z,,,(T), Tox,4 = X Texa = 0. Thus x,y, € WV (Te) — 
(T^") Hence e(T) = oc. This proves the theorem. 


Theorem 5.4l-D. Jf (T) and &(T) are both finite, then necessarily 
e(T) < &(T). 


PROOF. Let p = &(T). Then (5.41-1) shows that 
(5.41-2) A(T?) = T(Z(T?) O Z(T)). 


Now define a space Y, and an operator T, as follows: X, = A(T”), 
HAT) = ATAA (T), Tix = Tx if x e2(Tj). Equation (5.412) shows 
that Z(Tj) = Xj, so that èT) = 0. It is easy to see that Z(T,") = 
A(T9»)r 2AT) and Tix = Tx if xe2(Ty) This may be done by 
induction, using the fact that Z(Tv) = A(T?+1). Now clearly A (T7*!) c 
N Te), and W(Tr)  Z(Tt*) c W(To 9(Ty) SE AW(Ty). 

It therefore follows that 


Ait) = NT E Wr - wq). 


Consequently o(T;) € o(T). Since o(T) is finite, so is «(7,). But then 
«(T,;) = 0, by Theorem 5.41-C, and so 7,~! exists. Now suppose that 
x€.A(T**!), and let y = Tex. Then y e Z(T») GT) = Z(Tj). But 
T,y = Ty = Tr*1x = 0. Since Tj^! exists we conclude that y = 0, or 
xe (To) We thus have (Tet) (T9), whence (Te) = 
-W(T») This means that o(T) < p = 8(T), so'the proof is complete. 
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Theorem 5.41-E. If Z(T) = X and the ascent and descent of T are 
both finite, they are equal. 


PROOF. We have only to prove e(T) > 8(T), because of Theorem 
5.41-D. The case 8(T) = 0 is covered by Theorem 5.41-C; therefore we 
assume p = à(T) > 1. Then there exists an element y € A(T?!) — 
JI (T?) We can write y = T»-1x for some x. Let z = Ty = T?x, so 
that ze A(T). Now T»(Z(Tr)) = J(T?r) = A(T). Therefore, there 
exists some u € A(T?) such that Teu = z. Letv — x — u. Then 


Tev = Tex — Teru =z- z= 0, 
and 
T»-iy = Teix — Telu = y — T» Mu. 


Now T?-!u € Z(T?»-!) = dT»), because u € A(T»). Therefore y — T» lu 
Æ 0, because y is not in Z(T7). We see then that v € MN(T?) — W(T»-V, 
- and this implies o(T) > p = &(T). 

Our main interest in the ascent and descent of an operator arises from 
the facts set forth in the next two theorems. 


Theorem 5.41-F. Suppose that o(T) and &(T) are both finite, and let 
p = (T). Then (T») and N(T?) are linearly independent linear manifolds, 
and 


(5.41-3) BAT) = {&(T*) n PAT) & (Tr). 


PROOF. Suppose y € Z(T») A (T»). Wecan write y = Tex, Tey = 0, 
so that T?»x = 0. Then x € J(T?r). But «(T) < p, and so J(T?») = 
(Tr). Hence xe V(T?), and y — 0. This proves that &(T?) A 
M (T*») = (0), as required. For the proof of (5.41-3) we define X, and 
T, as in the proof of Theorem 5.41-D. Since A(T) = Xi, it follows by 
Theorem 5.41-B that A(T") = X,. Hence, if x e Z(T), there is some 
x, € HT?) = A(T)  Z(T) such that Tx, = Tex, = Tex. Then 
x—x,ENW(T*), Let x, =x—x,. Then x = x, + x; shows that 


BLT) c (d(T») n PAT) © (T). 
The reverse inclusion is evident, and so (5.41—3) is proved. 


Theorem 5.4l-G. Suppose that Q(T) = X and that o(T) and &(T) are 
both finite (and hence equal) Let p = 9(T). Then T is completely 
reduced by the pair of manifolds A(T?), N(T?), and T maps R(T’) in a 
one-to-one manner onto all of itself. 


PROOF. The fact that A(T?) A (T») = (0) and 
(5.41-4) X = RTA © (Tr) 
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is known from Theorem 5.41-F, since Z,(T) — X in this case. The 
invariance of (T?) under T is obvious; that of (Tr) follows from 
(5.412). The restriction of T to Z(T») is T,, as defined in the proof of 
Theorem 5.41-D. The asserted property of T, was established in this 
previous argument. 


We use the results of this section in the study of compact operators, 
in $ 5.5. 


PROBLEMS 


|l. It can happen that 93(7) — 0 and «(T)= œ. Consider X = P, 
HT) = X, and x= (£i, £5, RS Jj. Tx = (én £5, ER Jj. 

2. If 2(T) # X it can happen that «(7) < (T) when both are finite. Take 
AT) + X, Tx = xif xe AT). Then o(T) = 0, &T) = 1. 

3. Suppose that X is a Banach space and T is a closed linear operator with 
domain and range in X. Then points A of p(T) are characterized by «(A — T) = 
8(A — T) = 0; points of Po(T) by «(A — T) z 0; and points of Co(T) U Ro(T) 
by «(A — T) = Oand 8(A — T) > 0. 


5.5 Compact Operators 


In our study of compact operators we shall prove theorems which, 
when applied to Fredholm integral equations of the second kind, yield a 
great part of the most fundamental information about such equations. 


Definition. Let X and Y be normed linear spaces. Suppose T is a 
linear operator with domain X and range in Y. We say that T is compact 
if, for each bounded sequence {x,} in X, the sequence {Tx,} contains a 
subsequence converging to some limit in Y. 

A compact operator is also called completely continuous (in French, 
complètement or totalement continue; in German, vollstetig). We note at 
once that a compact linear operator is continuous. For, discontinuity of 
T would imply the existence of a sequence {x,} such that |x,| < 1 and 
||Tx,|| — œ, and this cannot occur if T is compact. 

We call explicit attention to the important general facts about compact 
operators which are stated-in problems 1-5 at the end of this section. 
Some other important facts are stated in the next two theorems.’ 


Theorem 5.5-A. If T e[X, Y] and T is compact, A(T) is separable. 


PROOF. Observe that Z(T) — U T(S,), where S, = íx:xl < ny. It 
n=1 


will suffice to prove that 7(S,) is separable. Now, since T is compact, 
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it is easy to see that every infinite subset of 7(S,) has an accumulation 
point in Y. Consequently (see the proof of Theorem 2.4-E) for each 
postive integer k there exists a finite set of points in T(S,) such that the 
spheres of radius 1/k with centers at these points cover T(S,) The 
aggregate of such finite sets, one set for each k, is evidently everywhere 
dense in 7(S,). 


Theorem 5.5-B. If Te[X, Y] and T is compact, the conjugate 
operator T’ is compact also. 


PROOF. Let {y,} be a sequence everywhere dense in A(T), and let 
{yk } be a bounded sequence in Y', say with |ly,'] < M. Since the 
numerical sequence y,'( y,), ¥2'(),), °°: is bounded for each n, we can use 
the diagonal procedure to obtain a subsequence of {y,’}, which we shall 
denote by (z,/), such that lim z,/(y,) exists for each m. It is then true that 

k=% 


lim z,'( y) exists for each y in A(T); this is easily seen from the inequalities 
k=% 
lze) — ZON « Iz/Q) — zen) 
+ Iz Qn) zx zj Yh) t |z; (Yn) nd zj (y)| 
< (liz I a llz;'l) ly n Yal! F Iz. (Yn) = Zi (Y), 


since (y,) is everywhere dense in A(T) as well as in Z(T). Now let 
X, = T'z,. If x € X, we have x,(x) = z, (Tx). Therefore jim xy (x) 


exists for each x € X, and the limit defines an element x' eX’. Our 
proof, will be complete if we show that 7T'z,' — x’. We assume this is 
not the case. Then for some «e > O there will exist a subsequence of 
{zk}, which we shall denote by {w}, such that ||T"wy,' — x'| > e for 
every k. Now w,'(Tx) — x'(x) is the value at x of the functional 
T'w, — x’. Hence there exists x, € X, with ||x,|| = 1, such that 


(5.5-1) we (Tx) — x'63)] 2 HIT wy — xl > «2. 


By the compactness of T, some subsequence of (Tx,) is convergent. 
Denote this subsequence by {Tu;}, and let (vj) be the corresponding 


subsequence of {wx}. Let Tu;— v. Then ve€4(T) Consequently 
lim v,'(r) = « exists. Now x’(u;) = lim z,(Tuj), by definition. Hence 
k=% k—o 


also x'(uj) = lim v,'(Tu;), for {vx} is a subsequence of {z,’}. Next, 
ko 
le) — vy (T2)| < lllo — Tw < Mlo — Tuil, 
and so 


(5.5-2) Ja — x'(u)| < Miv — Tui. 
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Now |v; (Tu) — x'(uj))) 2 e/2, in view of (5.5-1). But 
|o; (Tu) — x'(u)| < |v: (Tu) — vG)| + loi) — «| + le — x'(u?| 
« 2M Tu; — vll + |v;'(v) — æl, 


in view of (5.5-2). The right-hand member of this last inequality tends 
to 0 as i — oo, and so we reach a contradiction. The proof is then 
complete. 

The converse of Theorem 5.5-B is valid if Y is complete. See 
problem 5. 

Before going further with our general study of compact operators, let 
us consider some examples. 


Example |. Let X = C[a, b], where [a, b] is a finite closed interval. 
The scalars may be either real or complex. Let k(s, t) be a continuous 
function of s and t on [a, b] x [a, b], and let Ke [X] be defined as the 
Fredholm-type integral operator with kernel k [see (4.11-1) Then K 
is compact. The proof of this fact depends on a theorem known as 
Ascoli's theorem, which involves the notion of an equicontinuous family. 
A family F of elements of C[a, b] is called equicontinuous if to each 
€ > 0 corresponds a 8 > 0 such that |x(tj) — x(t2)) < « whenever x € F 
and £,, t; are points of [a, b] such that |tj — t| < 8. 


Ascoli's Theorem. Jf {x,} is a bounded sequence from Cla, b] such 
that the x,'s form an equicontinuous family, then {x,} contains a convergent 
subsequence (convergent in the topology of C|a, b]). 


This is a standard theorem. For reference see Graves, 1, page 122, 
or McShane, 1, page 336. 

Now consider any bounded sequence {x,} in Cía, b], and let y, = Kx,. 
Clearly {y,} is bounded, for ||y,| < |K|||x,|. Hence K will be proved 
compact if we can show that the y,'s form an equicontinuous family. 
Now k(s, t) is uniformly continuous, and hence to each e > 0 there 
corresponds some 5 > 0 such that |k(s;, ?) — k(s2, t)| < e/(b — a)M for 
all t if |si — s;| < 8; here M denotes sup ||x,||. Then for each n we have 


| yx 51) a VnlS2)| = 


[ [k(s;, t) — k(s2, D], (0 dt} < € 


if |s, — s;| < 8; thus the proof is completed. 

The operator K will still be compact with certain less severe restrictions 
on the kernel k. If K(s, t) is of class ¥2(a, b) as a function of t for each 
s, if 


b 
Í Ik(s, £2 dt 
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is a bounded function of s, and, if 
b 
[ Ik(s1, t) 7 k(s2, )p? dt —0 as ls: = 5| s 0, 


the operator K will be compact as an operator acting in C[a, b]. It is 
also compact as an operator acting in L?(a, b). The proof that K maps 
a bounded sequence into an equicontinuous sequence is made by using the 
Schwarz inequality. 


Example 2. If k(s, t) is an Z? kernel (see § 4.12), the corresponding 
integral operator K, acting in the space L(a, b), is compact. We prove 
this as follows. Choose a complete orthonormal set uj, uz, --- for 
La, b). With the usual notation for inner products, let «;; = (Ku,, u;), 
and let v; = Ku; Since k(s, t) is of class ¥? as a function of ¢ for almost 


all s, we have 
b CAU fia m 
k(s, t)2 dt =° k(s, t) u(t) dt? = vj(s)|2. 
[e opa =0 [ [6 2, lu 


Integrating with respect to s, we get 


Í Í ” Ks, 2)? dt ds = » Kul! 
ds 4 


But . 
[Kuj? = > \(Ku;, uj? = > ayl? 

Therefore 

(5.5-3) p if Ik(s, D|? ds dt = S m 


íj-1 
Now define an operator K, by the formula 
K,x = 2 aux, uj), x € L'(a, b). 
ij=l 
This operator has the #2 kernel 


n 


ks, f) = p: AOO 


j=l 


It is easily verified that 


(K,uj, uj) = | 


ai ifie nandj&n 


0 ifiorj >n. 
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Hence, by (5.5-3) applied to K — K, instead of K, we have 


b b [rs] n 
[ [6o — kalo, 12 ds dt = X lel- X deo 
a Ja mi 


‘j=l 


asn—> œ. But, as we know from § 4.12, 
b pb 
IK — KJ? < f f |k(s, t) — ks, D|2 ds dr. 


Hence |K — KJ|— 0. Now, K, is compact, for its range is finite 
dimensional (see problem 2). The fact that K, — K then assures us that 
K is compact (see problem 3). 


Example 3. If 1 € q « oo, a continuous linear operator A on l! into 
la is represented by an infinite matrix (o;)), where the condition on the 


matrix is that 
eo l/q 
|All = sup ($ evt] : 


i=l 
be finite (see problem 5, § 4.51). The operator will be compact if and 
only if, in addition, 
(5.5-4) l > lal? — 0 as n — œ, uniformly in j. 
i=n 
That this is a sufficient condition for compactness of A may be seen by 
using the result of problem 7, for, if y = Ax it follows from Minkowski’s 


inequality that 
oo 1/q oo 1/q 
p i < ixi (È eul) . 


The condition (5.5-4) is also necessary, again by problem 7, for the 
vectors v; = (o5, «5j, * - +) must form a conditionally sequentially compact 
set, owing to the compactness of A (note that v; = Auj, where uj is the 
vector whose ith component is 9;;). 

We now turn to the study of a compact linear operator T which belongs 
to [X]. We start by investigating the null manifold and range of ' 
(A — Ty when A +0. We do not require that X be complete. For 
convenience we write T, = A — T. 


Theorem 5.5-C. Suppose T€ [X], T compact, and } # 0. Then the 
null manifolds M(T,)(n = 1, 2, - - -) are finite dimensional. 


PROOF. We begin with n = 1. By Theorem 3.12-F it suffices to show 
that the set {x:||x|| = 1} A J(T;) is compact or-that every sequence from 
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it contains a convergent subsequence. Suppose ||x,|| = 1 and x, e (T,), 
so that x, = A-!Tx,. Since T is compact it is now evident that {x,} 
contains a convergent subsequence. For n >.1 we write 


Ty = (A — Ty = àn — nàIT +--+ (— Dy T^ —M— TA, 


where A is a certain member of [X]. Now TA is compact, since T is (see 
problem 4). The foregoing reasoning, applied to à” — TA, shows that 
(T^) is finite dimensional. 


Theorem 5.5-D. Suppose T e [X], T compact, and à #0. Then the 
ranges &(T,") are all closed. 


PROOF. Just as in the foregoing proof it suffices to treat the case 
n= 1. We suppose that Z(T;) is not closed; hence there is a sequence 
{T,x,} converging to a limit y, with y not in A(T,). Then y # 0, and 
hence x, is not in (T,) if n is sufficiently large. We may therefore 
suppose that no x, is in V(T,). Since (T,) is closed, the distance d, 
from x, to A '(T;)is positive. Choose u, € W(T,) so that |X, — unl < 2d,. 
Let 0, = |x, — u,|. We shall prove that 6, — oo. If this were not so, 
{x, — u,} would contain a bounded subsequence, and hence T(x, — u,) 
would contain a convergent subsequence. But 


XQ — Uy, = (A7) (T(x, = us) T T(x, ES u,)]. 


and T(x, — u,) = T,x,— y, so that (x, — u,} would also contain a 
convergent subsequence with some limit x. The corresponding subse- 
quence of {7,(x,, — u,)) would then converge both to T,x and to y, whence 
y —T,x€2K(T), contrary to assumption. Thus @,— œ. Now let 
v, = (x, — u,J0,. Observe that f 


(5.5-5) Tw, = (1/6,)T,x, — 0. 


Now 
v, = (ADIT W, + To,] 


and ||v,|| = 1. From (5.5-5) and the compactness of T it follows that 
{v,} contains a convergent subsequence with some limit v. From (5.5-5) 
it follows that T,» = 0,i.e.,0e V(T,). Nowletw, = u, + 0,7. Observe 
that w, € Jl (T), so that d, < ||x, — w,||. On the other hand, x, — w, = 
8,(v, — v), so that |x, — wyll < 2d,l|v, — vil, since 0, < 2d,. We see in 
this way that 1 < 2\|v, — vil, which contradicts the fact that {v,} contains 
a subsequence converging to v. We must therefore conclude that 2 (T) 
is closed. 


Theorem 5.5-E. Suppose T€ [X], T compact, and à #0. Then the 
ascent and descent of 4 — T are both finite (and hence equal). 
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PROOF. Suppose «(à — T) = oo. Then .(T*-!) is a proper closed 
subset of- “(7,") for n = 1, 2, ---. By Theorem 3.12-E there exists 
x E 4(Ty") such that |xj|— 1 and lx, — x 2 !/ if xe (TY, 
Assume | < m < n and let 


Z = Xm + XMTax, — ATX m 
Then 
TE-'z = Trl, + ATEX, — A-1T 2x, = 0, 


and so z€.4(T7-)) Consequently |i, — z| > 1/2. But we easily 
calculate that Tx, — Tx,, = A(x, — z), and so ||Tx, — Tx,J| > |A|/2 > 0. 
This shows that (7x,) can have no convergent subsequence,in contradiction 
to the fact that T is compact. Thus «(A — T) must be finite. 

The proof that 8(A — T) is finite is similar. If it were not, A(T,”) 
would be a proper closed subset of Z(T?- !) for n = 1,2,---.. We choose 
y, € 4T?) so that |y,| = 1 and |y, — yil 2 !/; if y eZ(T7*)). If 
lzmc«nlet 


W = Ya — AMT, + ATTY 
We can write y, = T*x, for some x,. Thus 
W = Tx, — AT, x, + AAT Xa, 


from which we see that we Z(77*!). Therefore jly,, — wii 2 3/2. But 
Tym — Ty, = My, — w) and so ||Ty,, — Ty,| > |A|/2, and we obtain a 
contradiction, just as in the earlier argument. This completes the proof. 

Our next main objective is to show that when A # 0 and T is compact, 
À is either an eigenvalue of T or in the resolvent set of T. For this 
purpose we prove that there exists a constant M such that if d(x) is the 
distance from x to (T,) (x arbitrary), then 


(5.5-6) d(x) < M|\T,x\\. 


If we suppose this not true, there exists a sequence {x,} of points not in 
(T;) such that d(x,)/|T4x,|| — oo. Since W(7)) is finite dimensional, 
there exists u, € //(T,) such that |x, — u,|| = d(x,). Let y, = (x, — uM 
d(x,. Then |y,| = 1 and 7T;y, — 0. From the equation 


Yn = UT, + Ty,) 


and the compactness of T' we infer that {y,} contains a subsequence 
converging to a limit y. Then the fact that Ty, — O implies T,y = 0. 
Then u, + d(x,)y € Á(T;), and so 


IX» n [un F d(x,y]il 


TU E 
lys — yl = dor) 2l. 
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This contradicts the fact that {y,} contains a subsequence converging to 
y. Thus (5.5-6) is proved. 


Theorem 5.5-F. Suppose T € [X], T compact, and à #0. If Mis the 
constant in (5.5-6), then, to each y € A(T,) there corresponds an x such that 
T,x = y and |xj < Mi|yl. Hence (A — T)! is continuous if it exists. 
The point A is either in p(T), in which case A(T,) = X, or it is in Po(T), in 
which case A(T,) is a proper closed subspace of X. 


PROOF. To prove the first assertion, suppose y = 7,x,. Choose 
u € N(T,) so that ||xi — ull = d(xi), and let x = x — u. Then Tyx = y 
and |[xi| = d(xj) < M||T,x,|| = Mjiyl. We know that either «(A — T) = 
&(A— T) =0 or 0«a(A — T) = (A — T) « o. In the first case 
(A — T) exists and Z(T,) = X, as we know from the definitions of 
ascent and descent. In the second case (A — T)! does not exist and 
&(T,) # X. The rest of the assertions are evident from what has been 
shown. 

The next question which arises naturally is this: How many points can 
there be in Po(T)? This question is answered in the next theorem. 


Theorem 5.5-G. Suppose Te[X] and T compact. Then Po(T) 
contains at most a countable set of points, and these have no accumulation 
point except possibly tne point X = 0. 


PROOF. We first observe the following: If Tx, = Ayx,(k = 1, +- n), 
where x, # 0 and the A,’s are all distinct, then xj, ---, x, are linearly 
independent. For, if not, let x,, be the first x, which is a linear com- 
bination of its predecessors, say Xm = eX; +° + e (X4. From 
Tx, — ÀmXm = 0 we obtain 


0- e (Ay oF Am) deese 6 1-1 m Ag) Xe 


Hence o, = +--+ = o4, , = 0, whence x,, = 0, which is a contradiction. 

Now, to prove the theorem it suffices to show that, if e > 0, the points 
À of Po(T) for which |A| > « form a finite set. Suppose the contrary for 
some e, and let {A,} be an infinite sequence of distinct points in Po(T) 
with |A,| > «. Then Tx, = A,x, where x, #0. The set of all the 
x,'s is linearly independent. Let M, be the linear manifold generated by 
X1,°++, X, Then M, 4 is a proper closed subset of M,. By Theorem 
3.12-E there exists u, € M, such that |lu,|| = 1 and |lu, — xli > !/ if 
x€ M, 4. Now Tu, € M,, since Tx, = A,x, and u,is a linear combination 
ofx,-.-.. x, But if x = ex; + +++ + a,x, we see that 


(An — T)x = e, Ax Hot + Opn 7 An) Xn 
so that (A, — T)(M,) € M,.,. In particular, (A, — T)u, € M,.,. There- 
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fore z = (A, — T)u, + Tu, € M,_; if 1 & m < n, and so also Aj!ze 
Mpi- Now 


Tu, — Tu, = Mu, — (uut, — Tu, + Tus) = Anly — A7 1z), 


and so [Tu, — Tum!| 2 |A,/2 2 </2. This contradicts the fact that 
(Tu,) must contain a convergent subsequence and completes the proof of 
the theorem. 

By various examples it may be shown that when T is compact the point 
A = 0 can belong to Po(T), Co(T), or Re(T); it cannot belong to p(T) if 
X is infinite dimensional. See problems 9-12. 

The next phase of our study concerns the conjugate operator T’. We 
know that it is compact (Theorem 5.5-B). From Theorem 5.3-A we 
know that T and T' have the same spectrum. Hence, if A # 0, then A is 
an eigenvalue of T if and only if it is an eigenvalue of T’. But more 
than this is true. 


Theorem 5.5-H. Suppose T € [X], T compact, and A #0. Then for 
each n the null spaces of T}? and (Tx) have the same dimension, and hence 
A — T and à — T' have the same ascent. 


PROOF. It suffices to give the proof for n = 1, because (T$) = (Ty 
and 7” = An — B, where B is compact (see the proof of Theorem 5.5-C). 
Suppose J/(T;) and (T,') are of dimensions m and n, respectively. 
We can assume m > 1, n > 1, because m = 0 implies n = 0 and con- 
versely. Let x,,---, Xm and uj’, +-+, u,' be bases for W(T,) and (Ty), 
respectively. It follows easily from Theorem 3.5-C that there exists a 
set of elements ui, ---, u, in X such that 


(5.5-7) uj (uy) = 9;;. 
Also, there is a set of elements x4', -+ +, Xm in X’ such that 
(5.5-8) x;'(xj) = 9j. 


This follows from Theorem 3.8—E (or from Theorem 4.3-D). 
We assume m « n and deduce a contradiction. We define an operator 
A by the equation 


m 
Ax = Tx + > x; (x)u;; 


i=l 


A is compact, by problems 2.and 3. Applying Theorem 4.6-C to 7), we 
see that 


(5.5-9) uj (Tx) = 0, xex, j= l, ec HS 
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We now prove that (A — A)! exists. For, 


(5.5-10) A - Ax = Tx — > x/Gyu; 

i=1 
If (A — A)x = 0, we conclude from (5.5-10), (5.5-9) and (5.5-8) that 
x1'(x) = +++ Xm (xX) = 0, whence 7,x = 0. But then x is a linear combi- 
nation of xj, +++, Xm, say X = aX; + +++ + e,X,. Applying x;' to x, 


we find that «; = 0, whence x = 0. Thus (A — 4A)! exists. By Theorem 
5.5—F, applied to A, we conclude that Z(A — A) = X. We then choose x 
so that (A — A)x = um: Now Ump(Um+1) = 1. But by (5.5-10), 
(5.5-9) and (5.5-7) we have 


m 


Mosi) = tma (Ta) — >. xi Cou) = 0. 


i=l 


From this contradiction we must conclude that m > n. 
Next we assume that m > n and deduce a contradiction. We define 
an operator B on X' by 


n 
Bx = T'x' + > xx, 
i=l 


and observe that it is compact. This time we use Theorem 4.6-F to 
observe that x; € 9{A#(T,')}, and from this we prove that (A — B)^! exists. 
We then choose x’ so that (A — B)x' = x;,; and obtain a contradiction 
of the fact that x;,,(x,,,) = 1. The reader can easily supply the details. 
Thus, finally, we conclude that m = n. 

The last of the theorems of this section tells us the exact relation 
between A(T,) and (Ty), with a dual result when 7, and T; are 
exchanged. 


Theorem 5.5-1. Suppose Te[X], T compact, and ^ 7 0. Then 
KT) = ANT: D, and 4(T,) = {ATY 


PROOF. The first relation follows from Theorem 4.6-D, because we 
know that &(T,) is closed. For the second relation we have only to prove 
that {~ (T)? C Z(T,), because of Theorem 4.6-G. Hence we start by 
assuming y' € {M (T). If y e A(T,), define f(y) = y’(x), where x is any 
element such that Tx = y. The value of y'(x) is the same, no matter 
which x is chosen, because y' € (./(T,))9. Clearly f is a linear functional 
on &(T,). Now, with y given, we can choose x so that T,x = y and 
lixl| <M ||y]| (Theorem 5.5-F). From this it follows easily that f is 
continuous. If we now choose x’ eX’ so that x’ is an extension of f 
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(and we can do this), we have x'(T4x) = y'(x) for every x € X, and so 
y = T/x'.. Thus y' € Z(T,), and the proof is complete. 

We conclude this section with a brief summary of the application of 
the theory of compact operators to the study of integral equations. We 
consider Fredholm equations of the second kind, in the form 


(5.511) Vs) = x(s) — A f k(s, t)x(t) dt, 


where the kernel k is of such a sort that the integral operator K defined 
by it is compact when acting in a certain specified normed linear function 
space X. We think primarily of X = C[a, b] or X = L%(a, b. We can 
write (5.5-11) in the form y = x — AKx. Note that the parameter A 
here occupies a different position than it does in our previous work, 
where we have been studying the equation y — Ax — Tx. There is no 
interest in the equation (5.5-11) when A = 0, so we can assume A # 0 and 
rewrite the equation as 


ACly = dv~Ix — Kx. 
Since à~! Æ 0, our theory of compact operators now tells us the following: 


For a given A # 0, either (5.5-11) has a unique solution x corresponding 
to each choice of y € X, or else the homogeneous equation 


(5.5-12) De f ed 


has a solution x #0. In this latter case the number of linearly independent 
solutions of (5.5-12) is finite. The number A^! is then an eigenvalue of 
the integral operator K. It is customary to call A itself a characteristic 
value of K. The set of characteristic values is at most countable. If there 
is an infinite sequence (A,) of such values, |A,| — oo. 

If the function space in question is C[a, b], the conjugate operator K’ 
acts in a different space. But, if we are dealing with L2(a, b) and if k 
is an £2 kernel, we can identify K’ with the integral operator in L2(a, b) 
such that K'x is represented by 


b 
f k(t, s)x(t) dt. 
In this case the theory goes on to tell us that (5.5-12) and the equation 
b 
(5.5-13) 0 = x() — à f k(t, s)x(t) dt 


have the same number of linearly independent solutions. Furthermore, if 
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À is a characteristic value, (5.5-11) has a solution in L? corresponding to a 
given y € L? if and only if 


[xoxo dt — 0 


whenever x is a solution of (5.5-13). 

Even when we are interested in the space C[a, b] the L? theory may be 
useful to us. Suppose that k is an 2? kernel such that Kx and K'x are 
in Cfa, b] whenever x € LX(a, b). This is the case, for instance, if K(s, t) 
is continuous in both variables (we assume that [a, 5] is a finite interval). 
Then, if y € C[a, b] and x € La, b) is a solution of (5.5-11), it follows 
that xe C[a, b]. Hence, in particular, the solutions of (5.5-12) are 
continuous, and the same is true of (5.5-13). Therefore it follows that 
all of the foregoing italicized assertions remain valid if we regard the . 77? 
kernel as defining an operator in C[a, b] rather than in L?(a, b) and 
restrict x and y accordingly. 

The theory of Fredholm integral equations of the second kind, in the 
form here presented, can be applied to obtain a solution of the Dirichlet 
problem in two dimensions, provided the region in question is of a 
sufficiently simple character (the essential restrictions are on the smooth- 
ness of the boundary) The same method can be applied to other 
boundary-value problems associated with the Laplace operator, e.g., the 
Neumann problem. For the Dirichlet problem in spaces of higher 
dimension, the procedure is slightly more complicated, because one has 
to deal with an integral operator which may not be compact. However, 
a certain power of the operator turns out to be compact, and this is 
sufficient to obtain the results stated in the first two sentences in connection 
with (5.5-12) (see the remarks following the proof of Theorem 5.8-F). 
These are the decisive results for the application to the Dirichlet problem. 
For more details see Riesz and Nagy, 1, pages 189-192 and Kellogg, 1, 
pages 311-315. 


PROBLEMS 


V. If X is finite dimensional and T is linear on X into Y, then T is compact. 

2. If Te (X, Y] and Y is finite dimensional, then T is compact. 

3. The set of compact linear operators on X into Y is a linear manifold in 
LX, Y] If Y is complete, this manifold is closed. For proof of the last 
assertion assume A, compact and in [X, Y], Be [X, Y], and ||4, ~ Bl| — 0. 
If (x,) is a bounded sequence in X, use the diagonal procedure to obtain a 
subsequence of {x,}, denoted by {u,}, such that lim A,(u,) exists for each k. 


Then show that (Bu,) is a Cauchy sequence in Y. 
4. If A, Be [X] and A is compact, so are AB and BA. 
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5. If Te LX, Y], Y is complete, and T’ is compact, then T is compact. For 
the proof use the relation 7"J, = J;T (using notation as in problem 3, § 4.5) 
and the fact that 7" is compact. 


eoo 
6. If X= P and (ej) is an infinite matrix such that > [o]? < oo, the 
A 
oo i 
equations 7; = > ayé; define a compact linear mapping y = Ax of X into 
j=1 


bo: E 
itself, with ||A]| < ( 2: is) : 
i j=l 
7. A set S in a normed linear space X is called conditionally sequentially 
compact if every sequence from .$ contains a convergent subsequence. If 
X = P, where 1 < p < œ, aset S in X has this property if and only if (a) S is 


oo 
bounded, and (5) » [£j]? — 0 as n — ©, uniformly for all x = (£j) in S. To 
i=n 
prove the sufficiency of these conditions use a diagonal procedure on the com- 
ponents of the given sequence {x„}. Boundedness of S is clearly necessary; the 
necessity of (6) may be proved by the method of contradiction. 

8. Show from Theorem 5.5-F that A — T takes open sets in X into sets which 
are open in the induced topology of (T). 

9. The point A = 0 has a status different from other points in relation to T 
if Te[X], T is compact, and X is infinite dimensional. In this case 0 can 
never be in p(T). To show this, assume the contrary, so that Z(T) = X and 
T has a continuous inverse. Suppose ||y,|| = 1. Choose z, = Tx, so that 
Zp — Yall < 1/n. Use the compactness of T to deduce that {y,} contains a 
convergent subsequence and hence that X is finite dimensional. 

10. Define T e [//] by y = (k-1é,], where x = (£4). Then T is compact, 
and 0 € Co(T). What are the eigenvalues? 

MH. Define T € [/!] by the matrix (tj) with tj; = 2175, i 2 2, t; = 21, i > 2, 
and all other 7; = 0. Then T is compact, and O € Re(T). What are the 
eigenvalues? 

I2. Suppose x9 € X, xý EX’, xoy'(xo) # 0. Define Tx = xg'(x)xy. Show 
that o(T) consists of the eigenvalues A = 0, A = xq'(xo) and that Ryy = A^ly + 
ATA — xo (xo) !Ty. 

13. Suppose X is not complete, and let T € [X] be compact. Let T be the 
unique continuous extension of T to all of the completion X. Then Tis compact 
and AT) c X. If Az 0, T? and 77 have the same null manifold, and so 
T, and 7, have the same ascent; also, Z(T3) = ATX) O X and TX — X)c 
X — X. Finally, o(7) = o(T). 

14. Suppose fe C(a, b]. Consider the inhomogeneous two-point problem 

y) + Af()y() = x), = y¥@™=a, yb) =f, 
and the corresponding homogeneous problem in which the function x is iden- 
tically zero. Show that, for a given A, either the inhomogeneous problem has 
a unique twice continuously differentiable solution corresponding to each 
x € C[a, 5], or else the homogeneous problem has a nonzero twice continuously 
differentiable solution. Also, the A's for which the latter situation occurs form 
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an at most countable set with no finite point of accumulation in the extended 
complex plane. Use the discussion in § 4.13, with Af(s) replacing a2(s). 


I5. Given Te LY, Y] (X and Y normed linear spaces) and T compact, then 
Tx, — Tx whenever (x,) is X’-weakly convergent to x. The essential thing to 
show is that, if {x,} is X’-weakly convergent to x, a subsequence of (Tx,) 
converges to Tx. This can be done with the aid of the conjugate operator 7". 
One can then conclude that Tx, — Tx, by assuming this false and. deducing a 
contradiction. 


16. Suppose T e LX, Y], where X is norm reflexive and T has the property 
that Tx, — Tx whenever (x,) is X’-weakly convergent to x. Then Tis compact. 
For operators in Hilbert space, this is the form in which the concept of a 
vollstetig operator was originally introduced. The proposition does not remain 
true if the hypothesis that . Y is norm reflexive is dropped. Example: take 
X= Y= |l!, Then the identity mapping is not compact, whereas X'-weak 
convergence is identical with convergence according to the norm (Banach, 1, 
page 137). 


5.6 An Operational Calculus 


If X is a complex Banach space and T'is a closed operator with domain 
and range in X, the fact that the resolvent operator R, = (A — T)! is 
analytic as a function of A enables us to obtain some important results 
by the use of contour integrals in the complex A-plane. Since X is 
complete, so is [X]; the completeness of these spaces assures us of the 
existence of the contour integrals with which we deal. These integrals, of 
functions with values in X or [X], may be defined just as in classical 
analysis. : 

First let us consider some aspects of the situation when Te[X]. In 
this case o(T) is bounded, and we have a power series formula for R, when 
[A > r,(T); see (5.2-4). If C denotes a simple closed contour, oriented 
counterclockwise, enclosing the circle [À| = rT), we can integrate 
(5.2-4) term by term around the contour, and we obtain 


(5.6-1) po f R, dà, 
2mi C 


because of the fact that the integral of each term of the series is 0, except 
for the first one. In a similar way, 


(5.6-2) T = xij APR dà p=0, Le. 
27i C 


Since R, is analytic except at the points of o(7), it is clear that the 
integral in (5.6-2) is unchanged in value if we deform the contour C in 
any manner, so long as it continues to enclose o(T). We may even 
replace the single contour C by several nonintersecting closed contours, 


288 INTRODUCTION TO FUNCTIONAL ANALYSIS [$5.6 


provided that no one of them is inside any other and o(T) lies in the 
union of their interiors. 

We now propose to define a certain class of complex-valued analytic 
functions and to associate with each such function f an element of the 
operator space [X]. The operator associated with f will be denoted by 
f(T). The feature of greatest importance in this association is that the 
correspondence between fand f(T) preserves the basic algebraic operations. 
That is, the operators corresponding to f 4- g, «f, and fg, respectively, 
are f(T) + g(T), «f(T), and /((T)g(T). In particular, then, since fg = gf, 
the operators f(T) and g(T) commute. 

In what follows we use Z(f) to denote the domain of definition of f. 


Definition. Suppose Te[X]. Let A(T) be the class of complex- 
valued functions f such that: (1) A(f) is an open set in the complex plane, 
and it contains o(T); (2) fis differentiable at each point of A(f). 


We do not insist that 4(f) be connected. If 4(f) has two components, 
for example, it is legitimate to have f(A) = A? on one component and 
(A) = 0 on the other. The definition means that f is analytic, in the 
sense of classical function theory, on each component of A(f), but there 
is no necessary connection, by analytic continuation or otherwise, 
between the values of f in different components. We say that fis locally 
analytic on o(T). 

Next we introduce some terminology and notation in connection with 
contour integrals. 


Definition. A set D in the complex plane is called a Cauchy domain if: 
(1) it is open; (2) it has a finite number of components, the closures of 
any two of which are disjoint; (3) the boundary of D is composed of a 
finite positive number of closed rectifiable Jordan curves, no two of which 
intersect. 


If C is one of the curves forming part of the boundary of D, the 
positive orientation of C is clockwise or counterclockwise according to 
whether the points of D near a point of C are outside or inside of C. The 
positively oriented boundary of D is denoted by + B(D); with the reverse , 
orientation it is denoted by — B(D). 

For our purposes the following are typical examples of bounded 
Cauchy domains. Unbounded Cauchy domains will be used later. 


Example |. The set {A:|A] < 1}U (4:2 < || < 3}. 
Example 2. The set {A:|A| < 1} U (:|A — 3| < 1}U fa: |A— 6| < 1}. 
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We are now ready to define an operator f(T) corresponding to 
fEAT). The definition is 


(5.6-3) f(T) = s — SAR, A, 


where D is any bounded Cauchy domain such that o(T)< D and 
D c A(f) Concerning this definition several comments are needed. 
(1) When f is given, there exists a Cauchy domain of the required sort. 
This is intuitively plausible; a detailed proof may be based on the con- 
struction given in Taylor, 2 (Theorem 3.3 and proof, page 65). (2) The 
integral in (5.6-3) has a value independent of the particular choice of D. 
This is so by an application of Cauchy’s theorem. For, if D, and D; 
are two Cauchy domains of the sort considered, we have o(T) € D, A Dz, 
and there exists a bounded Cauchy domain D such that o(T) c D and 
Dc D, D; Now D, — D is a bounded Cauchy domain, and its 
oriented boundary consists of + B(D,) and — B(D). Moreover, f(A)R, 
has no singularities in D4 — D or on its boundary, and hence, by Cauchy's 
theorem, the integral of f(A)R, over + B(D;) is equal to the integral 
over + B(D). The same result holds with D; in place of D,, and so our 
assertion is justified. (3) The integral in (5.6-3) is unchanged in value if 
we replace f by any other member of A(T), say g, such that f(A) = g(A) 
at each point A of an open set containing c(7). This follows from the 
foregoing remarks. 

We now show that the operator corresponding to fifo is ADAT). 
The proof depends heavily on the equation R, — R, = (u — A)R,R,, (see 
Theorem 5.1-C). Choose bounded Cauchy domains D;, D, such that 
e(T) C D, Dj, c D4 Dc Af) O A(f2). Then we express f(T) as an 
integral with respect to A over + B(D,) and f(T) as an integral with 
respect to p over + B(D;). Then we can write 


1 
2ni J +B(D1) 


(56-9 — fDXT) = OSE Í, no, PORR, du} d 


In this expression we replace R,R,, by 


and invert the order of the iterated integration where the second fraction 
is concerned. Since A € D; and yu is not in Di, we have 


l fx) 1 Ai) 
- = dÀ = fM - dà = 0. 
2ni J+B(D2) H — Aerea 2ni J«Bpp A — H 
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Hence we obtain from (5.6—4) the desired result 
ACA) = zf pp, YR, A = (ACD 
BUM) 

It is obvious from (5.6-3) that (f+ eT) =/(T) + g(T) and 
(«f XT) = «f(T). 

It is instructive to regard the association of f(T) with f as an algebraic 
homomorphism. But in order to be precise about this it is first of all 
necessary to convert A(T) into an algebra by an appropriate equivalence 
relation. We define two functions f, g as being equivalent (relative to 
T) if f(A) = g(A) on some open set containing o(T). Then A(T) is 
divided into equivalence classes, and these classes form a commutative 
algebra with a unit element if we define the algebraic operations in an 
obvious way, using representative functions. We have already noted 
that f(T) is unchanged if f is replaced by an equivalent function. 


Theorem 5.6-A. The mapping f — f(T) by the formula (5.6-3) is an 
algebraic homomorphism of the algebra of the equivalence classes of A(T) 
into the algebra [X]. This mapping carries the function f(A) = 1 into 1 
and the function f(A) = A into T. 


The proof is covered by the preceding discussion. The last two 
assertions are justified by (5.6-1) and 5. 6-2). 

The reader may have noticed that the formula defining f(T) has a 
striking appearance when for heuristic effect we write R, in the form 


A-T 
fcr) 2 X JOD n. 


2vi +B(D) A — T 
In formal structure this is just Cauchy’s formula, with T in place of a 
complex number. We refer to the use of the homomorphism f — f(T) 
and the consequences flowing out of it as an operational calculus for T. 
One use of the operational calculus is that it enables us to compute 
inverse operators in certain situations. 


Theorem 5.6-B. Suppose Te[X] and f € (T). Suppose f(A) #9 
when Ac o(T). Then f(T) sets up a one-to-one mapping of X onto all of 
X, with inverse g(T), where g is any member of X(T) equivalent to the 
reciprocal of f (X). 

PROOF. From /f(A)g(A) 2 | on a neighborhood of e(T) we infer 
S(T)g(T) = g(T)f(T) = I, and the conclusion follows. 


We now give an example which illustrates the operational calculus for 
a particular operator. 
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Example 3. Let X = C[0, 1], and consider the very special Volterra- 
type operator T, where Tx = y means 


x9 = f x ae 

It is easily verified by induction that 7"*!x = y means 

l s 

ys) == f (s — tyx(t) dt. 

ni Jo 
In this case the series (5.2-4) for R, converges whenever A # 0 (ie., 
o(T) is the single point A = 0). By using this series we find that x = R,y 
means 


(5.6-5) x(s) = 1x9) + 4 f ets=DAy(t) dr. 


In this case 9((T) consists of functions analytic in a neighborhood of 
A20. Iffis such a function, we can deduce the meaning of f(T) from 
(5.6-3) and (5.6-5). The relation y = /(T)x can be written 


Vs) = z j fox x(s) + x f els-D/ax(t) 2 dà, 


or 
(5.6-6) y(s) = f(0)x(s) + is xO AE eG-0/^ a} dt, 


where $ denotes integration counterclockwise around some sufficiently 
small circle |A| = r. We also write this in the form 


(5.6-7) JG) = fO)x(s) + [i F(s — x(t) dt, 
where 
(5.6-8) FQ) = d HS e^ dà. 


The function F turns out to be an entire function of exponential type. 
If f(A) is expressed as a power series in A, with radius of convergence o, 
the type of F is exactly 1/«. See problem 1 for more on this subject. 


We can use the operational calculus for this particular operator to 
solve the differential equation 


ys) + a YONG) «b ay G) = xG) 
with the initial conditions 


XO) = y') = +++ = yO) = 0, 
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where x € C[0, 1] and the coefficients a}, - - -, a, are constants. It is easy 
to see that y is a solution of this differential equation and satisfies the 
initial condition if and only if 


(+a,T+-++-+a,T)y = Tx. 


Now let g())-—1-ajÀ-c--::-c aX. The problem is to solve 
g(T)y = T"x for y. Since g(0) # 0, we know by Theorem 5.6-B that 
g(T) has an inverse. The operational calculus shows that y = f(T)x, 
where f(A) = A”/g(A). Hence, by (5.6-6), the solution of the problem is 


ys) = f x) {55 $y econdi) dt, 


where the contour encloses A = 0, and all the zeros of g(A) are outside 
of the contour. By the change of variable z = A^! this solution can be 
put in the form 


z s 1 els- tz d dt, 
Ae f MD I$ + az. zu) 


where the contour is counterclockwise and encloses all the zeros of the 
polynomial in the denominator. The integral may be evaluated by 
computing residues. 


It is desirable to develop a generalization of the formula (5.6-3) so as 
to yield an operational calculus for T when T is any closed linear operator 
with domain and range in X. It turns out that such a development is 
possible provided that the resolvent set p(T) is not empty. When we 
give up the condition that T € [Y], the spectrum of T need no longer be 
compact; it might be empty or it might be the whole plane. However, 
we assume explicitly that o(7) is not the whole plane; we also assume 
that Tis closed. This permits us to utilize Theorem 5.1-C. 


Definition. By %.(7) we mean the class of complex-valued functions 
f such that: (1) A(f) is an open set in the complex plane which contains 
o(T) and is such that the complement of 4(f) is compact; (2) f is differ- 
entiable in 4(f) and f(A) is bounded as |A| — oo. 


We know from function theory that f(A) approaches a finite limit as 
àj — œ, and we denote this limit by f(oo). We may then say that fis 
locally analytic on e(T) and at oo. 

We may define an equivalence relation in 2(5(T): two functions are 
equivalent if they agree on a neighborhood of o(T) and also on a 
neighborhood of oo. As before, the equivalence classes form a com- 
mutative algebra in an obvious way. The function f(A) = 1 determines" 
a unit for the algebra. 


$5.6] SPECTRAL ANALYSIS OF LINEAR OPERATORS 293 


In seeking the proper replacement for (5.6-3) we observe that Cauchy's 
formula for an element of (7) holds in the form 


, 1 JA) 
(5.6-9) SÈ = AO) + 55 |g D 
where D is an unbounded Cauchy domain such that D C A(f) and ¿€ D. 
Note that the complement of an unbounded Cauchy domain is compact; 
in fact, there is just one unbounded component of such a domain, and 
its complement is compact. 
The appropriate definition of f(T) when f € Uo(T) is 


] 
(5.6-10) NT) = flo + i f A08 ad, 
where D is an unbounded Cauchy domain such that o(7)< D and 
Dc A(f) The three comments made after (5.6-3) have counterparts in 
the present situation. Observe that /(T) € [X] even though T need not 
be in [X ]. 

As an illustration of 4(f) and D, suppose o(T) is the entire real axis. 
Then, for some positive r and e, A(f) must include all points for which 
[^| > r and all points for which the imaginary part of A is in absolute 
value less than e. We could then take D to be the union of the sets 
{A:|A| > 2r}, {A:|A] € 2r and Im |A} < ej2). 

As in the case of Theorem 5.6-A, the mapping f — /(T) defined by 
(5.6-10) is an algebraic homomorphism of the algebra of equivalence 
classes of X(T) into the algebra [X], and the algebra preserves the unit 
element, i.e., f(A) = 1 maps into f(T) = /. To see the truth of this last 
assertion let D; be the complement of the D in (5.6-10). Then D, is a 
bounded Cauchy domain, D, c p(T), and + B(D) = — B(D,). Since 
R, is analytic on p(T), the integral in (5.6-10) vanishes if f(A) = 1. In 
this case f(oo) = 1, and we get f(T) = /. The proof that (fi (T) = 
1(T)f2(T) is similar to the corresponding proof based on (5.6-3), and we 
leave the argument to the reader. One must use (5.6-9). 

If T is not in [X], we must use (5.6-10) instead of (5.6-3). But, if 
T € [X] and f € («(T), the operator f(T) given by (5.6-10) is the same as 
that given by (5.6-3). To prove this, choose for the D in (5.6-10) the 
union of a bounded Cauchy domain D, and the exterior of a very large 
circle C which encloses D,, where o(T) € D, and D, € A(f). Then the 
integral. over + B(D) in (5.6-10) becomes the integral over + B(D,) 
plus an integral around C. Since ||R,||-> 0 as |A[| — œ (when T e [X], 
it is easy to prove by standard methods that the integral around C cancels 
the term f(co)/. 

Corresponding to Theorem 5.6-B we have: 
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Theorem 5.6-C. If T is closed, f € 9(X(T) and f has no zeros on 
o(T) or at co, the operator f(T) has an inverse which belongs to [X]. This 
inverse is g(T), where g is any member of Ux(T) equivalent to the reciprocal 


of JO). 


The proof is the same as for Theorem 5.6- B. 

A polynomial of degree n > 1 does not belong to 9((T). Nevertheless, 
it is convenient to be able to deal with polynomials in connection with 
the operational calculus. We consider now how this is to be done. 

If P(A) is a polynomial of degree n, we define P(T) in the obvious way, 
by putting 7* in place of A* in the expression for P(A); the domain of 
P(T) is Z,(T), as defined at the beginning of 85.41. We have several 
lemmas which are useful in dealing with polynomials. 


Lemma 5.6-D. Suppose f € X(T), and suppose either (a) that f has a 
zero of order m at oo, or (b) that f vanishes identically in a neighborhood of 
ov. Let P be a polynomial of degree n, where 0 < n < m in case a and 
O0 « n in case b. Let F(A) = P((). Then FEUX(T), the range of 
S(T) lies in 24T), and F(T) = P(T)f(T). 


For an indication of the proof see problem 6. 


Lemma 5.6-E. Suppose f € Ux{T), « € p(T), and an integer n 2 0 are 
given, and suppose that g € A(T), where g(4) = (« — Ayf(3). (Note that 
this hypothesis is essentially a condition on the behavior of f near À — co.) 
Then f(T)Z,(T) © 2,,,(T) when k z 0. 


PROOF. If x€Z,(T) we can write x = (Ry for some y. Then 
f(x = Gurg( DGU)y = (UVyrr*g(T)y € 2,40). 


Lemma 5.6-F. If f € 3(:(T) and P(A) is a polynomial of degree n > 1, 
then f(T)P(T)x = P(T)/(T)x if x e 24T). 


PROOF. Let G(A) = (x — Ay "PQ). Then G(T)= P(T\(R,)" (see prob- 
lem 6). If xeZ,(T), we can write x = (R,)"y. We know f(T)x e Z,(T) 
(Lemma 5.6-E) Then P(T)f(T)x = P(T)f(T(Ryyy = GCD)f(Dy = 
JOD)P(TY(R;Yy, and the proof is complete. 

We see next how to express P(T)x as an integral. 


Theorem 5.6-G. Suppose « € p(T). Let D be any unbounded Cauchy 
domain such that o(T) c D and « is not in D. Then, if P(A) is a polynomial 
of degree n and x € 2,(T), 

l P(A) 


.6- port NONE Mr AERE pm ntl A. 
GED POE xij o ay 7 rx d 
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If f € A(T) we can also compute f(T) by this formula for any n > 0, by 
putting f(A) in place of P(A) and f(T) in place of P(T), provided we choose 
D so that (T) c D and Dc A(f). 


PROOF. We start from the formula 


(T — ay*!Rx = (A — atl Rx — > (A — eyc*(T — adkx, 


k=0 


which is easily established by induction. The evaluation of the integral 
in (5.6-11) then becomes a matter of evaluation of familiar integrals, 
from which the final results are easily obtained. We leave details to 
the reader. 

The next theorem is a generalization of Theorem 5.6-C. 


Theorem 5.6-H. Suppose fEUx(T) and f(A) #0 if XE o(T), but 
that f(oo) = 0, the zero at œ being of finite order m. Then f(T) has an 
inverse, the range of f(T) is £,(T), and for x € Z,(T) we have 
(56212). T) Hx = AA — ey) (T — ayr Rx dd, 

2i J+B(D) 
Here « € p(T); « and the unbounded Cauchy domain D are to be chosen so 
that o(T) © D, D c A(f), « is not in D, and f(A) 4 0 if Ae D. 


PROOF. Let g(A) = (a — Aynf(A) Then g has no zeros on o(T) or at 
œ, so that g(T) has an inverse belonging to [X]. Now f(T) = (R,)*¢(T). 
Hence f(T) has the inverse [g(7)]-!(« — Ty” with domain Z,(T). We 
calculate [/(T)]-!x = [g(T)]-« — Ty"x by using (5.6-11), putting 
n = 0, I/g(A) in place of P(A), and (c — T)"x in place of x. The result 
is (5.6-12). 

We now consider an example of a closed operator with unbounded 
spectrum. 


Example 4. Let X = C[0, 27]. Let Z(T) be the set of continuously 
differentiable functions x € X such that x(0) = x(27), and let Tx = y 


mean y(s) = — ix'(s). To compute R, we solve the differential equation 
x'(s) — iAx(s) = — iy(s) 

with the condition x(0) = x(27) on the solution. We find that the values 

A=0, +1, t2, --- are in the point spectrum, the eigenfunctions 


corresponding to A = n being multiples of eis. All other values of s 
are in p(7), with x = R,y expressed by 


ein 22 e ie 
— = —_ jA(s—t) — iA(s—t) * 
(56-13). x(s) = 5S f eis- y(t) dt — i fie -0 y(t) dt 
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Now suppose f€ 9o(7). This means that fis analytic at oo and also 
in some neighborhood of each of the points of o(T). For the purpose 


of computing /(T) we may assume that f(A) = > a," when 
0 

|A| > N + 1/3, where N is some positive integer, and that near A = k 
(K = 0, + 1,---, + N) fis given by f(A) = g,(A), where g, is analytic 
at A=k. In computing f(T) by formula (5.6-10) we can take D to 
consist of the exterior of the circle C: |A| = N + !/; and the union of the 
interiors of circles Cp: |A—k| < 1/4, k=0, +1, +--+, +N. The 
contribution to /(T)x from integration around C, turns out to be 


2n 
a) T x(t)eikG-n dt = gi(KKé,ei's, 


where £, is the Fourier coefficient of x(t) with respect to e/^. The general 
formula for y = /(T)x is a bit lengthy, and we forego writing it out here. 
However, in the special case where f(A) = ag when [A|] > N + !/,, 
things are much simpler, and y = f/(T)x is expressed by 


N 


(5.6-14) X) = ax) + > (be — aset 


k=—N 


where b, = g,(k). The coefficients ag and 5, can be assigned arbitrarily. 
From Theorem 5.6-C we get the interesting result that, if ag and the 
b,’s are all different from zero, the solution of (5.6-14) for x is 


1 xb i 
= — yi a iks 
x9 = 259 > (E - a nme 
k=—N 
where the n's are the Fourier coefficients of y. 


If we impose special conditions on T, there may be various other ways 
besides that indicated by (5.6-10) for developing an operational calculus. 
The cases in which T is such that o(T) lies in a half plane (Hille, 1, 
Chapter 15) or in a strip (Bade, 1) are of great interest, and in these cases 
very interesting and useful operational calculi have been developed. 


PROBLEMS 
l. If fA) = Ša, àn in (5.6-6), show that F(u) = Š antem) in (5.6-8). 


If the radius of. convergence of the f series is œ, F is of exponential type 1/o. 
See R. P. Boas, 1, page 839. We see that f determines F; conversely, F 
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determines f, except that ag is left arbitrary. Any Volterra-type integral operator 
with kernel F(s — 7), where F is an entire function of exponential type, is an 
operator f(T), where f is analytic at A = 0 and /(0) = 0. 


[r2] o 
2. Iff() = > a, in (5.6-6), show that f(T) = > a, 1, the series converging 
0 0 
in [X]. 
3. Let X = Cla, b] (a finite interval). Let T be the differentiation operator, 
Tx = x’, where 2(T) is the set of those x € X such that x(a) = 0 and the 


derivative x’ also belongs to X. This operator is closed, and o(7) is empty. 
Show that x = R,y means 


x(s) = — ip eX5-0 y(t) dt. 
If f € 9, (T) is defined by f(A) = > aA", show that f(T)x = y means 
0 
(s) = agx(s) + li F(s — t)x(t) dt, 


where F(u) = > a„+ı(u”/n!). The situation here is closely related to that in 
0 


Ss 
Example 3, because y = T-!x raeans y(s) = f x(t) dt. 
4. When T is closed and p(T) is not empty, RD is closed. Outline of proof: 
If « € p(T), let A = (T — o)-1, Write P(A) = » bÀ — a)", plu) = P biu, 
0 


by x 0. Then P(T)x = p(AXT — ayx if x e G(T). Now (T — a)” is cloud 
for it is the inverse of A”. It can then be proved that P(T) is closed. See 
Taylor, 2, Theorem 6.1. If p(T) is void, it can occur that T is closed but 7? is 
not. Here is an example: Let X = /? x P7. If (x, y) eX let lx, y»)? = 
lxi? + Iyl. If x = {ék} and y = {ny}, define T(x, y) —((k?n,3, (k£43), with 
AT) consisting of all (x, y) with y € 12 and {kép} € l. 


5. Suppose a € p(T). Then the function f(A) = (« — A) "(n > 1) belongs to 
A(T), and f(T) = (R,)". Prove this for n = 1 directly from (5.6-10), using 
the fact that R, = R, + (a — A)R,R,. For general n the result can be proved 
by induction. 


6. To prove Lemma 5.6-D let g(A) = (a — A)"f(A), where œ € p(T). Then 
f(T) = (R,)"e(T) (use problem 5). Let G(A) = (æ — A)-"P(A) and show that 
G(T) = P(T)(R,)" by expressing P(A) as a sum of powers of a — À. The 
relation F(T) = P(T)f(T) now follows at once. 


7. Let P(A) by a polynomial of degree n > 1 all of whose zeros lie in p(T). 
Then P(T) has X for its range, and it has an inverse belonging to [XY] and given 
by 
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the integration being extended clockwise around a set of nonoverlapping circles, 
one centered at each zero of P(A), each circle and its interior lying in p(T). 
Method of proof: Let f(A) = 1/P(A) and apply Theorem 5.6-H. A comparison 
of (5.6-12) for this case with (5.6-11) shows that [f/(7)]-!x = P(T)x, whence 
[P(T)] ! = f(T). Then apply (5.6-10). 

8. Let T be the operator of problem 3. Use the formula in problem 7 to 
solve P(T)y = x for y, where P(A) is a polynomial of degree n. Compare with 
the last part of Example 3. 

9. Let X = H? (see Example 8, $83.11). Define 7x(1) = tx(t) (x € X, t the 
complex variable. Then Te [X], o(T) = {A:|A| < 1). Iff e9t(T), /(T)x(t) = 
f(ix(0. 

10. Let X = L(0, oc), and let T be the differentiation operator Tx = x’, with 
Z(T) determined by those functions in .Z(0, c») which are absolutely continuous 
on [0, a] for every finite a > 0 and whose derivative is again in -Z(0, oo). It 
can be seen from Example 4 in § 1.5 that o(T) consists of all A for which the real 
part of Ais < 0. Also, x = R,y is expressed by 


x(s) = I y(t)eXs-0 dt. 


Discuss the nature of X(T) and the form of f(T) in this case. 


5,7 Spectral Sets and Projections 


The results of this section are related to the concept of reducibility (see 
$5.4). As we shall see, we can obtain a pair of subspaces which reduce 
T completely if we can split the spectrum of T into two parts of a suitable 
nature. We assume throughout the section that X is a complex Banach 
space and that T is a closed linear operator with domain and range in 
X. We also assume as always that p(T) is not empty. 

In addition to the concept of the spectrum of T, we need the concept of 
the extended spectrum of T. "This is a point set in the extended complex 
plane (Le., the one-point compactification of the ordinary plane, by 
adjunction of the point oc). We denote the extended spectrum of T by 
oT). It is defined to be the same as o(T) if T € [X] and to consist of 
c(T) and the point oo if T is not in [X]. Observe that c,(7) is always 
closed and nonempty. 


Definition. A subset o of c,(T) is called a spectral set of T if it is 
both open and closed in the relative topology of o,(7) as a subset of the 
extended plane. This is the same as requiring that both o and o,(T) — e 
be closed in the extended plane. 


An isolated point of o,(T) is of course a spectral set. If o is a spectral 
set and if one of the sets o, o,(T) — c contains oo, then the other one is 
bounded as a subset of the ordinary plane. 
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If c is a spectral set of T, we can define an fe A(T) such that 
f(À) = 1 on a neighborhood of c while f(A) = 0 on a neighborhood of 
oT) — c. We then denote the operator f(T) by E, When e, occurs 
as a subscript on E or X in what follows, we write o(1) instead of o,, for 
convenience in printing. Likewise with op. Since /(/)/(4) = f(A), the 
homomorphism shows that E,E, = E, so that E, is a projection. We 
call it the projection associated with c. Evidently the function 1 — f(A) is 
related to o,(T) — c in the way that f is related to o; consequently J — E, 
is the projection associated with the spectral set o,(T) — o. If we denote 
o and o,(T) — c by c, and c, respectively, we see that Ej + Ej) = 1, 
and Es E = o2) És(1) =Q. Let Xa be the range of Exi it is a 
closed subspace. We see that X,(j, O Xam = (0) and X, © Xe) = X. 

To show that T is completely reduced by (X,(1). X,(7)) it suffices to show 
that E,52(T) € Z(T) and E,qy)Tx = TEx if x e A(T) (see § 5.4). 
These things follow from Lemmas 5.6-E (with n = 0, k = 1) and 5.6-F. 

The foregoing considerations can easily be generalized to the extent 
stated in the following theorem, proof of which is left to the reader. 


Theorem 5.7-A. Suppose o{T) = e, U -+ U op, where 03, +++, o, are 
pairwise disjoint spectral sets of T. Let Ei) be the projection associated 
with c; and let X, be the range of Ei). Then T is completely reduced 
by (X; ++ Xom) Le, I= Esay coo Eom: EqpEn = 0 ifi +j, 
GAT) is invariant under Esq, and Xj) is invariant under T. 


In the next theorem we examine the restriction of T to the range of E,. 


Theorem 5.7-B. Let o be a spectral set of T, and let T, be the 
restriction of T to the range X, of E, (with Z(T1) = Z(T) X). Then 


g = ofT}). 
. o O Po(T) = Po(T)). 
. € N Co(T) = Co(T)). 
. o (à Re(T) = Ro(T)). 
e. If o does not contain oo, then X, c 2,(T) for each n > 1, and T; is 
continuous on X,. 


an oSA 


PROOF. It is convenient to prove (e) first. When o does not contain 
oo, we have E, = f(T), where one property of f is that f(A) = 0 on a 
neighborhood of oo. We can then apply Lemma 5.6-E, with k = 0 and 
n arbitrary, to conclude that X, € Z,(T). But now T; is defined on all 
of X,, and hence it is continuous, for T, is closed (since T is) and X, is 
complete. Here we use Theorem 4.2-1. 

Next we prove (a). Here it is convenient to write o} = 9, o; = o,(T) 
— a; and to denote by T; the restriction of T to X45. Select any finite 
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point u not in o,. If f is the function used in obtaining f(T) = Esa), 
let g(A) = (u — 2) 1/(A). Then g € f(T), fg = g, and so (y — T)g(T) 
= Ex) and E,)g(T) = g(T), from which it appears that p — T and 
g(T) are inverse to each other when restricted to X,(;. Consequently 
u € p(T). This shows that every point of o(T,) is a finite point of o,; 
likewise for e(7;) and c. Hence o(7;)Mo(T2) is empty. Now 
o(T) = c(T)) U o(T;) (by Theorem 5.4-Ca). It therefore follows that 
c(T) is identical with the set of finite points of o,; likewise for o(T2) and 
oz. In view of (e) this proves (a) for the case in which oo is not in aj. 
If oo isin oy, then Tis notin [X]. Also, œ is not in 2, so T; is continuous 
on X, by e. It follows that T, cannot belong to [X,(1)], for otherwise 
T would be in [X]. Therefore oo € c,(T)), and (a) is completely proved. 
Assertions b, c and d now follow from Theorem 5.4-C. 
The following simple example is instructive. 


Example l|. Let X = I (/2 would do just as well). Let {A,} be a 
sequence of distinct nonzero numbers such that A, — 0, and define Tx by 
T{é,} = (£j). Then o(T) consists of the points Ài, 49, -- - and 0. The 
resolvent is defined by R, {ék} = {(A — Ap té}. Let E, be the projection 
associated with the spectral set formed by the single point ,, and let 
Qy be the projection associated with the spectral set consisting of Ay41, 
Ayi2, +c and O. Let {u,} be the standard countable basis for /!, i.e., 
u, = (1, 0, 0, ---), uz = (0, 1, 0, ---) etc. Then we have 


x= 2, E ug, E,x = £t, Onx = > £u. 


N+1 
Notethat/ = E, +---+ Ey + Qy. Also, TE, = AEk, andso T = A,E, 
+--+ + àyEn + TQy. It is interesting to see what happens as N — oo. 
We have ||Qyx\|| — 0 for each x, and so, for each x, 


xc > E,x (convergence in X). 
1 


But ||Qy||; = 1, and so we cannot write I = > Ej (with convergence in 
1 
[X]). However, ||TQx|| — 0, and so we do have 
T= > AE (convergence in [X’}). 
I 


We also have 


" oo E,x B [ro] E, 
P esr but not Ry = 2476 
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For another instructive example we revert to $ 5.6. 


Example 2. Consider the operator T of Example 4, 8 5.6, where the 
space X is C[0,2z]. For this operator o,(T) consists of the points 
0, +1, -2,--- and œ. If E, is the projection associated with the 
spectral set consisting of the single point A = n, we easily find from 
(5.6-13) that E,x(s) = £,ei"s, where é, is the Fourier coefficient of x(t) 
with respect to e, If Qy is the projection associated with the spectral 
set consisting of + (N + 1), + (N + 2),--- and ©, we find that 


Qux) = x) — > de. 


=—N 


In this case it is not always true that Qux — 0 as N — œ. It is true, 
however, if x € Z(T), by a standard theorem on Fourier series. Thus we 
can write 


(5.7-1) x= > Ex 


— 0 


when x€ Z(T). We have TE, = nE,. In general it is not true that 


oo 


(5.7-2) Tx = > nE, x 


—9o00 


when x e Q(T). But this is true if x € Z;(T), since E,Tx = TE,x = nE,x, 
and in this case we can use (5.7-1) with Tx in place of x. 

It is interesting to see what happens in the foregoing example if we 
change the basic space X in which the operator T works. Suppose we 
take X = L2(0, 27) and define Tx = — ix’, with Z(T) the subspace of X 
determined by those x such that x(s) is absolutely continuous on [0, 27], 
with x(0) = x(27) and such that x'(s) belongs to #2(0, 27). The spectrum 
and the formula for the resolvent are just as before, and the formulas for 
E, and Qy are unchanged. But now (5.7-1) holds for all x € L2(0, 27). 
For, if we let u,(s) = eins/V 2r, the set (un = 0, + 1, + 2, ---) isa 
complete orthonormal set (see $3.22), and (5.7-1) is just the standard 
expansion of x with respect to this orthonormal set. That is, E,x — 
(x, u,)u,. Formula (5.7-2) is now true for every x in Z(T), for 
(Tx, Unun = (x, Tu)u, = (x, nuj)u, = nE,x. 

We return again to the general theory. It is easily seen that, if c is a 
spectral set of T, then E, = 0 if and only if o is empty, and E, = I if and 
only if c = c,(T). Now, if ZT) # X and if o(T) is nonempty and 
bounded, then o(T) and (oo) are complementary nonempty spectral sets. 
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In this case, therefore, the projection associated with oe(T) is neither 0 
nor J. 

We conclude this section with a theorem which is in a way a companion 
to Theorem 5.6-H. 


Theorem 5.7-C. Suppose that o(T) is bounded and that f is an element 
of (T) which vanishes on a neighborhood of oo but has no zeros on o(T). 
Then f(T) has the same range and null manifold as the projection associated 
with o(T). In particular, f(T) has no inverse if Z(T) # X. 


PROOF. We consider two disjoint parts of 4(f): the component 
containing oo, in which f(A) = 0, and the rest of 4( f), which is a neighbor- 
hood of o(T). We define two functions g and h: g(4) = 0 and A(A) = 1 
on the first part of A( f), g(A) = 1 and A(A) = f(A) on the other part. Note 
that ^ has no zeros on o(T) or at oo, so that A(T) has an inverse belonging 
to [X]. Note also that (T) = E,, where e = o(T). Now fg = f and 
gh = f. Hence f(T)E, = E,f(T) = f(T) and E,A(T) = ACT)E, = f(T). 
The truth of the theorem follows from these relations, in view of the fact 
about the inverse of A(T). 


5.71 The Spectral Mapping Theorem 


The following generalization of Theorem 5.2-D will be needed in § 5.8. 
We assume T closed. 


Theorem 5.71-A. Jf fE€ UAT), the spectrum of f(T) is exactly the 
set of values assumed by f(A) as A varies over the set o{T). In symbols, 


oLf(T)] = fle(T)]. 


PROOF. To show that /[o,(T)] € o[f(T)], suppose u € o(T) and define 
g(a) = A — ug) FQ) — flu) if Az p, while g(u) —/'(u). Then 
(e — 3)g0) = f(u) — fA), and so (y — T)g(T) = f(u) — f(T), by Lemma 
5.6-D. We can permute u — T and g(T) on Z(T). It now follows either 
that the range of /(u) — f(T) is not all of X, or that this operator has no 
inverse; hence f(u) ec[/(T)]. It remains to prove that f(oo) € o[f(T)] if 
T is not in [X], or, what is the same thing, if Z(T) # X. We can assume 
f(x) — f(a) # 0 if A€o(T), for otherwise the situation is covered by 
what has been proved. We can now apply either Theorem 5.6-H or 
Theorem 5.7-C to the function f/(oo) — f(A) and conclude either that the 
range of f(oo) — f(T) is not all of X or that this operator has no inverse. 
In either event f(oo) € o[f(T)]. 

We now have to prove that o[f(T)] € f[o(T)]. Consider first a point 
B €c[f(T)] such that 8 z f(oo) and suppose, contrary to what is to be 
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proved, that f(A) — B has no zeros on o(T). Define A(4) = [B — f(3)]-1 
on a suitable neighborhood of o(T). Then Ahe9(4(T), and A(T) and 
P — f(T) are inverse to each other, so that 8 € p[f(T)], which is a contra- 
diction. If 8 = /(oo) and T is not in [X], we know that oo € c,(T), and 
hence £€f[o,(T)]. It remains only to consider the case 8 = f(oo) e€ 
c[/(T)] TE [X]. In this case we can replace f by another function g, 
agreeing with fon a neighborhood of o(T), but such that g(o0) # £. Then 
g(T) =f(T) and g[o,(T)] = f[e(T)], and the earlier argument shows 
that 8 € g[c,(T)]. This completes the proof. 

We also need the following theorem, for the general case of a closed 
T with nonempty resolvent set. For T € [X] this is the same as Theorem 
5.2-D. 


Theorem 5.71-B. Jf P(A) is a polynomial, P[o(T)] = o[P(T)]. 


The proof can be patterned after that of Theorem 5.71-A. At one 
stage in the argument the result of § 5.6, problem 7, is needed. 

The next theorem increases the scope of the operational calculus by 
enabling us to deal with composition of functions. 


Theorem 5.71-C. Suppose fEUxo(T), S= f(T), and ge?9t(S). 
Suppose also that f(oo) € A(g) (if T € [X] we may always suppose f modified 
near X= coo, if necessary, to make /f(o))e4(g). Define F by 
FO) = glf()] if fA) e A(g). Then F € UAT) and F(T) = g(S). 


PROOF. Using Theorem 5.71-A, we see that o(T) = A(F). Choose a 
bounded Cauchy domain D such that o(S) € D, D c A(g), and f(«) € D. 
Choose an unbounded Cauchy domain D, such that o(T)< Di, D, € A(f), 
and f(D,) < D. Then 


FT) = Foyt sf SAOIR d 
and, if £ € B(D,), 
A 
all =, [eon a. 


2ni Js) À — S(O) 
If A(é) = [A — A]! [A fixed on B(D)], we see that A(T) = (A — S)-1. 
Since 
sil ga) 
PESE 2ni +B(D) A — f(oo) as 
and 
1 


; gQ — S)! da, 
2mi J+BD) 


a(S) = 


the conclusion of the theorem follows by easy calculations, which we 
leave to the reader. 
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One important application of the preceding theorem is to prove the 
next theorem, which is used in proving Theorem 5.8-F. 


Theorem 5.71-D. Suppose f € X(T), S = f(T), and let 7 be a spectral 
Set of S. Leto = e((T) fv). Then o is a spectral set of T, and the 
projection E, associated with c and T is the same as the projection F, 
, associated with 7 and S. 


PROOF. Let us write o^ = e,(T) — e, r = o(S) — r. From Theorem 
5.71-A we see that f(o Uo’) = TU 7. Hence e' = o (T) O f-!(7), and 
it follows that c and o’ are complementary spectral sets of T. Since 
E, + Ey = I and F, + F; = I, the relation E, = F, is implied by 
Ey = Fy. Hence, in proving the theorem, it is allowable to assume that 
c is a bounded set in the ordinary plane and that f(0o) is not in 7, for, if 
this is not true, we can deal instead with o’ and 7. Now let Ui, U2, 
Us, U, be open sets with the following properties: Ü, and Ü; are disjoint, 
and so are U3, U4; U, and U, are bounded neighborhoods of 7 and c 
respectively; U, contains 7’, f(co), and a neighborhood of oo; U4 contains 
a’ and a neighborhood of œ; Ü, and Ü, are in A(f) and f(QU) € Ui, 
J(U4) € U,. Such sets do exist. Define f, = 1 on Uj, f, = 0 on Uy, 
f[.-1 y: U, f, 20 on Uy. Then £[/(2)] = /,(4) on U;'U U4. But 
TAS) = Fp f(T) = E, and so F, = E, by Theorem 5.71-C. 


PROBLEMS 


I. Suppose « € p(T) and let A = R, Use Theorem 5.71-A to show that if 
p(o ~ A) = 1, p €o(A) if and only if Aec(T). If u € p(A) and pe — B) = 1, 
use Theorem 5.71-C to show that (u — 4)! = u^! + w^?Rg. Take f(A) = 
(a — A1, g(A) = (p — A. Show also that Rg = uA(p — A). 

2. Suppose « € p(T) and A = R,. Make the transformation u = (« — ÀA)! 
from the A-plane to the p-plane. If fe 9(,(T) and g is defined by g(u) = f(A), 
g(0) = f(oo), show that g(4) = f(T). 

3. Suppose X a complex Banach space, A and Bin [X], A # Band AB = BA. 
Then, if A9 € c(A), there exists A, € o(B) with |À; — Ag| < IIA — BI. Suggestion: 
Suppose the proposition false, and let C = I — (A; — AYào — B)! = (A — B) 
(Ag — B). Let r = ||4 — Bl. Show that r,((Ag — B)*!] < i/r and hence 
(see problem 7, 85.2) that r,(C) < 1, whence 1 €p(C). From this follows 
readily that Ag € p(A), a contradiction. 


4. Consider the operator A of Example 2, § 5.3, with X taken as any fixed 
lp, Suppose > |e,| < oo, and let f(A) = > a,A", [À] < 1. Also let P,(A) = 


> a,A*, Define S = > «,À^ (series convergent in [X]. Show that o(S) = 


fi [o(A)]. This is not a direct application of Theorem 5.71-A, in general. Why 
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not? For f[o(4)] € o(S) use Theorem 4.1-D, and for e(S) — f[o(A)] use 
problem 3 (above) on S and P,(A). 


5.8 Isolated Points of the Spectrum 


As in several preceding sections, we assume here that X is a complex 
Banach space and that T is closed. Then A, is analytic as a function of 
à on p(T), and an isolated point A, of o(T) is an isolated singular point of 
R, Hence there is a Laurent expansion of R, in powers of A — Xo. 
We write this in the form 


(5.8-1) Ry = X (A= AA, + D A = 20) "Be 
0 1 


The coefficients 4, and B, are members of [X], and this series representa- 
tion of R, is valid when O < {A — Ao| < ô for any 6 such that all of 
o(T) except àọ lies on or outside the circle {A — Ag| = 8. These co- 
efficient operators are given by the usual standard formulas: 


pos l —1 
—n Xr 
A, = mha Yo)" IR, dA, 


(5.8-2) 
B, = as [ 0 — X7 Rd 
2ni C 


where C is any counterclockwise circle [À — Ag| = A with 0 <A < à. 

It turns out that there are several important relationships among these 
coefficient operators. The demonstration of these relationships can be 
made conveniently by using the operational calculus. Choose r > 0 so 
that 2r < 8. Define functions f, as follows: 


> o5 = f if |A — Ag] < r 
mew ea ae ep eee foe) 
(5.8-3) 


cA Aer AANS 
EDIN o if |A — Ag] > 2r. 


These functions all belong to X(T), and f,(0c) = 0. If we compare 
the definition of (T) with formulas (5.8-2) we see that 


A, = — faT), 0, 


5.84 a 
i l : B, Jt) n 2 1. 


il 
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We note in particular that B, is the projection E, for the case in which a 
is the spectral set consisting of the single point X». Since o is not empty, 
we know that B, # 0. The only case in which B, = Z is that in which 
Z(T) = X and o(T) consists of the single point Ag. (See the remarks 
preceding Theorem 5.7-C.) 

Now let us observe that 


(A — Afr. AQ) = 40), nz 
(A i Ao)f (9 = fq), nz 
(A = ADA) + fa) = 1. 


From these relations and Lemma 5.6-D we obtain the formulas 


0, 
l 


, 


(5.8-5) (T = AgAnet = Ans 
(5.8-6) (T — A9)B, = B,44 = (T — Ag Bi, 
(5.8-7) (T — d)Ap = B1- 1. 


The second part of (5.8-6) is obtained from the first part by induction. 
Some further facts are indicated in problem 1. 

As in the classical theory of functions, we shall say that Ag is a pole of 
R, of order m if and only if B, # 0 and B, = O when n > m. From 
(5.8-6) we see that B,,; = 0 if B, = 0. Hence A, is a pole of order m 
if and only if B,, # 0 and B,,, — 0. In that case B,,---, Bm are all 
#0. If Ag is an isolated point of o(T) but not a pole of R,, we call it 
an isolated essential singularity of R} 

The case of a pole is of particular interest. 


Theorem 5.8-A. If Ao is a pole of R, of order m, then Xo is an eigen- 
value of T. The ascent and descent of Ag — T are both equal to m. The 
range of the projection B, is the null space of (Ay — T)", and the range of 
I — B, is the range of (Ag — Tyn, so that 


(5.8-8) X = (Ty) D (Ty) (To = ào — T). 


The operator T is completely reduced by the two manifolds occurring in 
this direct sum. 


PROOF. Let X; = (Bj) = AU — Bj), X2 = (Bj). Then X = Xi 
@ X5; both subspaces are closed, since B, is continuous. We know 
from the early part of § 5.7 that T is completely reduced by (X, X2), 
for J — B, and B; are projections associated with complementary spectral 
sets of T. For convenience we denote the null space and range of 
(Ag — T) by JW, and Z, respectively. If xe Mp where n > 1, we 
see by (5.8-5), induction, and (5.8-7) that 0 = A, (T — Agyx = 
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(T — AA, ax = (T — A)Aex = Bix — x, so that x = Bix e X. Thus 
MN, C X; ifn 21. On the other hand, it follows from (5.8-6) that, if 
x EX, we have x = Byx and (T — Agyx = B,,41x. Since B,,4, = 0 if 
n> m, it follows that X; C M, and hence M, = Xz, if n 2 m. But 
N m-ı is a proper subset of Mm, for Bm #0, and N m-1 = Nm = X; 
would imply Bm = 0, because of the relation Bm = (T — Ag)"-1B,. We 
have now proved that the ascent of Ay — Tis m and that Mm = X>. In 
particular, since m > 0, Ao is an eigenvalue of T. 

Now let T, and T, be the restrictions of T to X; and X; respectively. 
We know by Theorem 5.7-Ba that A, is not in o(T3), for it is in o(T;). 
Hence the descent of Ay — T; is 0, and the range of (Ay — T1)" is X, when 
n Zl. Hence certainly X, c 4, Now, if n 2 m, the only point 
common to &, and M, is 0. For, if x€e4,0 Mm we can write 
x = (Ay — Tyy and (Ay — Tyx = 0, whence y € Man = A n and therefore 
x —0. Now suppose n > m and x € Z,. Write x = x; + x», where 
X;€ Xj. Thenx; = x — x, € 2, because Yi € Z, Butx; € X); = Mm 
and so x; = 0, whence x = x, € Xy. Thus Z, — Xj if n 2 m. We now 
know that Z, = X, if n > m and, therefore, that the descent of Ay — T 
is less than or equal to m. Theorem 5.41-D then shows that the descent 
is exactly m, which we know to be the ascent. This completes the proof 
of the theorem. 

The next theorem is concerned with conditions on f such that /(T) = 0, 
where fe A(T). When this theorem is applied to the special case in 
which X is finite dimensional and T e [X], it yields the conditions which 
determine the minimal polynomial associated with T, i.e., the polynomial 
P(A) of lowest degree such that P(T) = 0. 


Theorem 5.8-B. Suppose f€ A(T). In order that f(T) = 0 it is 
necessary and sufficient that the following conditions be satisfied: 


a. If Ag is a pole of R, of order m, either f(A) = 0 in some neighborhood 
of Xo or f has a zero of order at least m at Xo. 

b. f(A) = 0 in some neighborhood of each isolated essential singularity 
of Ry. 

c. f(A) = 0 in each component of A(f) which contains infinitely many 
points of o(T). 

d. f(A) = 0 in some neighborhood of co if Z(T) # X. 


PROOF. As a preliminary to the proof let us suppose that Ag is an 
isolated point of o(T), that fe A(T), and that there is no neighborhood 
of Ay in which f(A) = 0. There will then be some smallest integer k > 0 
such that /* (Ag) 4 0. Now choose r as in (5.8-3), and define g, so that 
it is analytic at Ay and g,(A) = (A — Ag)yk ^f) if 0 < |A— Al <r, 
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BCA) = (A — Agy-*-! if [A — ào] > 2r. We may also restrict r so that 
fis analytic and f(A) # 0 when 0 < Jà — Ag| < r. Then g, € (T) and 
[z.(T)] ! exists, by Theorem 5.6-H. Referring to (5.8-3), we see that 
(A — oye AFA) = FASA). Hence (T — A9*g,(7D)B, = f(T)B,. 
We can write this in the forms 


(5.8-9) g( TT — Ao) By = f(T)B,, 


(5.8-10) Bert = [00] 1/(O7)B1; 


to get the second form we make use of (5.8—6). 

With these preliminaries established, let us now assume that f(T) = 0, 
If Ao is a pole of order m of R, and if there is no neighborhood of A, in 
which f(Ag) = 0, we see from (5.8-10) that B,,, = 0, where k has the 
significance explained in the preceding paragraph. Hence, since Bm 4 0, 
we conclude that m < k. This shows that condition a in the theorem is 
satisfied. We also see that b is satisfied. For, if Ag is an isolated 
essential singularity of R,, then B, # 0 for every n, and this is incompatible 
with (5.8-10) if f(T) = 0. Next we observe that o[/(T)] consists of the 
single point 0 when f(T) = 0. Since o[f(T)] = f[e(T)], we conclude 
that f(A) = 0 at all points of o,(T). That condition c must be satisfied 
now follows from the fact that f is locally analytic on 4(f) and at oo, 
for e,(T) is closed and the extended plane is compact. Finally, suppose 
HAT) z X. Then /(oo) = 0, since oo &e,(T). If oo is an accumulation 
point of e(T), it follows that f(A) = 0 in the component of 4(f) which 
contains oo. If oo is isolated in o,(T) and f(A) is not identically zero in 
any neighborhood of oo, this means that oo is a zero of f of some finite 
order k. Let g(A) = A*f(À) Then ge&9(«(T) and g(oo) #0. But 
g(T)-2 T*/((T) 20, and therefore g(oo) = 0, for o[g(T)] = (0) = 
g[o.(T)]. Thus (d) must be satisfied if /(7) = 0. 

Now, conversely, suppose that f satisfies conditions a-d in the theorem; 
we shall show that f(T) = 0. We may suppose that there is at least one 
component of A(f) in which f(A) Æ 0, since otherwise the conclusion 
S(T) 20 is a direct consequence of the defining formula (5.6-10). 
Because of the conditions on f, the fact that o(T) is closed and 
o(T) € A(f), it follows that there are at most a finite number of points of 
e(T), say àj, +--+, àp all of them poles of R,, in the union of those com- 
ponents of 4(f) where f(A) 40. Now, if QT) # X, condition d shows 
that the definition of /(T) can be put in the form 


(5.8-11) ID=- Í f/Q)R, dà, 
j=1 j 
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where Cj, ---, C, are small nonoverlapping counterclockwise circles with 
centers at A,, ---, A, If no such points as ry, «++, A, exist, then 
J(T) = 0 by Cauchy’s theorem. If A(T) = X, formula (5.8-11) is still 
valid, for the behavior of f near oo is irrelevant in this case. Let E; 
be the projection associated with the spectral set consisting of the single 
point A. It is then clear by the definition of E; and the homomorphism 


rules of the operational calculus that (5.8-11) becomes 


p 


AD) = > KDE, 


j=l 


It therefore remains only to prove that /(T)E; = 0 for each j. Let à; 
be a pole of order m; of R,, and let its order as a zero of f be k;, so that 
m; < kj, by condition a. If we apply (5.8-6) with A; in place of Ay and 
E; in place of By, the fact that A; is a pole of order m; implies (T — A)5E; 
= 0. Formula (5.8-9), applied with this change in notation, shows that 
S(T)E; = 9. This finishes the proof. 
Our next principal result is Theorem 5.8-D, which is a sort of converse 
of Theorem 5.8-A. An important tool in the proof of this theorem is 
furnished by the following lemma. 


Lemma 5.8-C. Lert A, be an isolated point of o(T), and let B, be the 
projection associated with Ag as a spectral set. Then x € &(B,) if and only 
if lim (T — Ag)"e™x = 0 for every « > 0 (or, equivalently, if and only if 


no 


I(T — Agyx|/" +0). In order that this be so it is sufficient to have it 
true for a single « such that A € p(T) if 0 < |À — Ao| < e. 


PROOF. If x €Z/(B,) we have x = B,x. It follows from (5.8-6) that 
Bax z T = Ao)". Then, by (5.8-2), 


1 
(T = Are = us f (A= Aare mR a, 


where the radius of C may be taken less than «e. Consequently, 
(T — Age x — 0. For the converse the motivation is that of finding an 
operator which is nearly the same as B, but has an inverse. We define 


AQ) = {1 — (A — Are), 


where « is prescribed as in the last sentence of thelemma. Then Theorem 
5.6-H applies to A,; A,(T) has an inverse, which is evidently 
I — (T — Aye. To calculate 4,(7) as an integral, Jet C, be the circle 
[A — Ao| = ri, C? the circle |A — Ao| = r2, where O < ry < e < ry and 
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AE p(T) if 0 < |A— Ag| < ri. Then, with proper orientation of the 
circles, ' 


1 1 
h(T) = 3 y hy(A)R, dd — z= y h A)R, dA. 


We can also write 


1 
B, = xi]. R, da. 
From these formulas it is easy to see that |A,(T) — B, — O0. If now 
(T — Agyie7^x > 0, we can write x = A,(T)[/ — (T — Agye"]x, and so 


x — Bix = [A(T) — Bi]x — A(T((T — Agye^x > 0. 


Thus x = B,x € Z(By), as was to be proved. 
In the next theorem we consider a fixed Ap, and we denote the range 
and null space of (Ay — T by Z, and /,, respectively. 


Theorem 5.8-D. Suppose there is an integer n such that 4, Y AW, = 
(0). that 2, is closed and X = 2, Ð N, and that the smallest integer for 
which all these things are true is m, with m > 1. Then ^ is a pole of R, 
of order m. 


PROOF. We observe at the outset that M „m contains nonzero elements. 
For, if Mm = (0), then M m-1 = (0) also. Then X = 4, ON, = 
s C X, 4, whence X = Z, ,.. Then Z, 410,4 = (0), Zm- is 
closed, and X = Z, , D M m-1, contrary to the definition of m. 

First we shall show that T is completely reduced by (2m, Nm) We 
leave to the reader the easy verification that 7.4, C Mm and 
T[Z, O P(T) € By. If we write x = x, + xz, where x, € 2m, X2 € N m 
let Ex = x,, Ex = x). The projections Ej, E; are continuous, by 
Theorem 4.8-D. Clearly Z(T) is invariant under E>, since Mm c Z(T). 
Also, Z(T) is invariant under E,, because x € Z(T) implies Ex = 
x — E;x €eZ(T). This finishes the demonstration that T is completely 
reduced by (Zm, Mm) Let T, and T; denote the restrictions of T to 
Bumn and Mm respectively. Then T, is defined on all of Mm and is 
therefore continuous, for 75 is closed. Also, Theorem 5.4-C is 
applicable here, and in particular, o(T) = o(T3) Y o(T;). 

The next step is to show that Ao is a pole of the resolvent of T}. Choose 
a fixed point « € p(T) [then «€ p(T.) also], and let f(A) = (Ag — à)” 
(æ — A)ym-1,. Then f(T) = (Ag — T)"R?*!, Now f is in %0(T>) as well 
as in Ao(T), and it is easily verified that /(T>) is the restriction of f(T) 
to V,,. But, if x E V,,,f(T)x = RT*(Ag — Ty"x = 0,andso/(7;) =0: 
We now apply Theorem 5.8-B. The conclusion is that o(T>) consists of 
the single point Ao, which is a pole of some order m, of (A — T2)~!, with 
I< m, & m. 
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Next we prove that Ag € (Tj). From this it will follow that Ag is an 
isolated point of o(T). Let P(A) = (Ag — A)”. We shall show that 
P(T;) = (ào — Tı)” has an inverse with domain all of Z, If 
xe. n2Z,(T) and P(T)x = 0, this means that x € Z, O NMN m and 
hence that x = 0. Therefore P(T;) has an inverse. If y € Z,, we can 
write y = (Ag — T)"x for some x € Z,(T), by definition. If we write 
x = Ex + Ex, it follows that y = (Ag — T)™E\x = P(Tj))E,x. Thus 
the range of P(Tj) is all of Zm. Now P(T|)) is closed (see problem 4, 
$ 5.6), and so the inverse of P(Tj) is a closed operator defined on all of 
Zm, it is therefore continuous, by the closed-graph theorem. This means 
that 0 € p[P(7,)]. But o[P(T5)] = P[o(T))] (Theorem 5.71-B). Conse- 
quently P(A) has no zeros on o(T); i.e., Ag is not in o(T)). 

Now we can regard the single point Ag as a spectral set of T and obtain 
the corresponding projection Bı. We shall prove that Z(Bj) = MN m 
For this we use Lemma 5.8-C. It is clear that Nm — &(B)), for 
(Ag — Tye"x = Q if e >0,n > m and xE Nm Let H = (à; — T3). 
We have just seen that A9 € e(7,). Choose e > 0 so that eH] « 1, 
and suppose x&€4(Bj. Then (Ao — T)ye*x—0. Now certainly 
(Ag — TyE;x =0 if n2 m, and hence (Ay — Ty«e-E,x—0. Let 
Yn = (Ap — Tye"E,x. Then y Em and Hy, = «Ex. Hence 
Ex = lleH"y,l| < (e|Hliyliy,l. We conclude that E,x = 0, whence 
xc ,. Thus &(B,) = Nm 

Now, the fact that Ap is a pole of order m, of (A — T;)-!, the under- 
lying space being Mm, enables us to conclude that Ag is also a pole of 
order m, of R,. The details of this inference are indicated in problem 2 
at the end of the section. It remains only to show that m = mı. We 
know that m, < m; m, < m is impossible, as we see by Theorem 5.8-A 
and the assumed minimal character of m. Thus, finally, the proof of 
Theorem 5.8-D is complete. 

We now have the following result: 


Theorem 5.8-E. Jf T belongs to [X] and is compact, each nonzero 
point of o(T) is a pole of R,. 


PROOF. Suppose Ag€o(T) A #0. Then «(As — T) = (ào — T) 
= m > 1 (Theorem 5.5-E). The fact that Ag is a pole of order m of R, 
now follows by Theorems 5.5-D, 5.41-G, 5.8-D, 5.8-A. Detailed 
verification is left to the reader. 

A different proof of this theorem can be had by way of the next theorem. 

Since a pole of R, is an eigenvalue of T (Theorem 5.8—A), it is useful 
to have some means of deciding whether a point of o(T) is a pole of R,. 
One important result along such lines is contained in the following 
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theorem, in which T can be any closed operator with nonempty resolvent 
set. 


Theorem 5.8-F. Suppose f € A(T), and let f(T) be compact. Then, 
if Ag € o(T) and f(Ag) £ 0, ào is a pole of R, Moreover, if B, is the 
projection associated with the spectral set (Ag), the range of B, is finite 
dimensional, and hence the eigenmanifold corresponding to Ag is finite 
dimensional. 


PROOF. Let S = f(T), u = f(Ag). We know that u € o(S), by Theorem 
5.71-A. Leto = o,(T) ^ f-). We know from $ 5.5 that p is isolated 
in o(S), so that (u) is a spectral set of S. Then c is a spectral set of T, 
and the projection associated with (p) and S is E, (associated with c and 
T), by Theorem 5.71-D. Let X, = &(E,), and let Sọ be the restriction 
of Sto X,. Then o(So) = (u) (Theorem 5.7-B), and so 0 € p(Sp), whence 
x = SoSo Ix if xe X,. Since Sọ is compact, this implies (by means of 
Theorem 3.12-F) that X, is finite dimensional. Now let 7, be the 
restriction of T to X¥,. We know from Theorem 5.7-B that o = c,(T)). 
We also know that c,(Tj) cannot be the entire extended plane, for 
c,(T]) € oT) and p(T) is not empty, by assumption. It then follows 
that X, = GT), for otherwise we could conclude from the finite 
dimensionality of Y, that for no A can the range of A — T, be all of Y, 
and hence that o,(Tj) is the entire extended plane. Consequently 
T, € [X,] and o = o(T)) is a finite set. Since Ay € ø, this means that Ag 
is isolated in o(T). It is easily seen that E, = B, + P, PB, = 0, where 
P is the projection associated with o — (Ao) and B, is defined as in the 
theorem. Hence Z(B,) € X,, and so A(B,) is finite dimensional. When 
T is restricted to A(B,), its resolvent must have a pole at Ao, because of 
the finite dimensionality. But then Ag is a pole of R, (see problem 2). 
Since the eigenmanifold corresponding to Ag, namely (Ag — T), is 
contained in Z(B), it must be finite dimensional. 

The foregoing proof uses certain facts about the spectrum of an operator 
in a finite-dimensional space. These facts are evident as soon as we 
introduce a basis and represent the operator as a matrix, using deter- 
minants to find the spectrum and the resolvent. A discussion which 
covers these matters without appeal to determinants appears in $ 5.9. 

One important application of Theorem 5.8-F is to the case in which 
Te[X] and T” is compact for some positive integer n. Clearly we can 
choose f € («(T) so that f(A) = à” on a neighborhood of o(T), and then 
f(T) = T”. Hence, if T” is compact for some n, every nonzero point in 
o(T) is a pole of R, and the corresponding eigenmanifold is finite dimensional. 
It can happen, for example, that 7? is compact though T is not. 
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Example. Take X — L(a,b), where (a,b) is a finite or infinite 
interval. Let k(s, t) be a measurable function on (a, b) x (a, b) such that 
|k(s, D| < A(s) almost everywhere, where he X. Define Kx — yp to 


b 
mean y(s) — Í k(s, t)x(t) dt. Then K e [X]; K need not be compact, but 


K? is compact. See Zaanen, 1, pages 322-323. Also Dunford and 
Pettis, 1, page 370 and Phillips, 1, page 536. 

Another important application is to the case of an Operator (not 
necessarily a member of (X ]) whose resolvent is compact. We note that 
as a result of (5.1-2), if R, is compact for one A in p(T), it is compact 
for every such A (see problems 3 and 4 in § 5.5). Suppose « € p(T) and 
that R, is compact. Now R, = f(T), where f(A) = (« — 2)**. Theorem 
5.8—F then shows that in this case every point of o(T) is a pole of R,. This 
is the situation which prevails in the case of certain differential operators, 
that of Example 4, § 5.6, for instance. 


PROBLEMS 


I. Show that the coefficients in (5.8-1) satisfy the relations (a) A,,A, = 
— Amansis (D) B4B, = Bois 5 (0 AmB, = 0, (d) A, = (— IAG. Show 
also that 4(4,) C 2,,1(T) if n > 0 and 2(B,) € Z,(T) if n > 1 and k 7 0. 

2. Let Ag be an isolated point of o(T), and consider the Laurent expansion 


oo 
(5.8-1). Show that > (A — Ag"B, converges if A # Ap. Let Xo = A(B,), and 
1 
let To be the restriction of T to Xo. Then Tọ € [Xo]. Let C, be the restriction 
of B, to Xo, and let S,= > (A— Ao) "C, Using (5.8-6), show that 


1 
S, = (A — To) if Az Ap. Note that B,B, = B, and so conclude that A, is 
a pole of order m of R, if and only if it is a pole of order m of |S). 

3. Take X = I! and define 4e[X] by the matrix (a,j), where œ; = Bi, 
aiz = €34 = Msg = *:* = 1, and all other entries in the matrix are 0. Suppose 
B; — O0. Then A is not compact, but A? is compact. Discuss o(A) and the 
resolvent. 

4. If 2(T) # X there exists no polynomial P(A) # 0 such that P(T)x = O for 
every x € Z,(T) (n the degree of P). If such a polynomial P did exist, choose 
a € p(T), f(A) = (a — A)-"-1P(X), and show that f(T) = 0. Then use Theorem 
5.8-B. 


5. Suppose that o(T) is bounded and that 2(T) # X. Then R, has an 
expansion in powers of À valid when |A| > r,(T), say Ra = > ATA, + > A^B,. 
I 0 


Show that TB + I= Aj, TB, = B, ,, TA, = Áj,41. Show that B, # O for 
each n and that A, is the projection associated with the spectral set o(T). 
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5.9 Operators with Rational Resolvent 


Let X be a complex Banach space. A function f of the complex 
variable à, with values in X, is called a rational function if it is expressible 
in the form f(A) = p(9/Q(A), where p(A) is a polynomial in A with co- 
efficients in X and Q(A) is a polynomial with complex coefficients. We 
assume that p(A) and Q(A) are never zero at the same point. A rational 
function also has a partial-fractions representation. Just as in classical 
analysis it may be proved with the aid of Liouville's theorem that, if the 
function f is holomorphic on the whole plane except for a finite number 
of poles and if f(1/A) has a pole or a removable singularity at A = 0, 
then f is rational. This is done by expressing /(A) as the sum of a poly- 
nomial and the singular parts of its Laurent expansions at the various 
poles. 

In this section we consider operators T for which the resolvent R, is a 
rational function with values in [X]. If T & [X] and o(T) consists of a 
finite number of points, each a pole of R, then R, is rational, for 
\|R,|| > 0as A — oo. Itis impossible to have R, rational if T is closed but 
not in [X] (see problem 5, § 5.8, which indicates that R, has an essential 
singularity at oo in this case). Our discussion of operators with rational 
resolvents includes a determinant-free treatment of the situation when X 
is finite dimensional. 

We begin with consideration of the question as to when P(T) = 0 if 
T € [X] and P(A) is a scalar polynomial. We could appeal to Theorem 
5.8-B, but we prefer a more elementary argument. 


Theorem 5-9A. Suppose T € [X], and let P(A) be a scalar polynomial 
of degree 2 1. Then P(T) = 0 if and only if there exists a polynomial 
q(^) with coefficients in [X] such that 


(5.9-1) PQ)R, = qa) 
when A € p(T). 


PROOF. Let Q(A, u) be the polynomial in A and u such that P(A) — P(u) 
= (à — p)QQ, pg) With T in place of p we have P(A) — P(T) = 
Q(A, T)(A — T). Multiplication by R, gives P(A)R, — P(T)R, = QQ, T). 
Suppose now that P(T) — 0. Then we obtain (5.9-1), with g(A) = 
Q(A, T). On the other hand, if we start from (5.9-1), we see that 
.P(T)R, = q(4) — QQ, T), and hence 


lg) — QA, T)i| < PDI ILR. 


Since ||R,||->0 as ÀA— oo, we conclude by Liouville’s theorem that 
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q(4) — Q(A, T) is a polynomial in A which is identically zero. It follows 
that P(T)R, = 0, and hence P(T) = P(T)R(A — T) = 0. 


Theorem 5.9-B. Suppose Te [X]. There exists a scalar polynomial 
P(A) of degree > 1 such that P(T) = 0 if and only if R, is rational. 


PROOF. If R, is a rational function of A, it is expressible in the form 
R, = q(d)/P(A), where q and P are polynomials with no common zeros. 
We know that o(T) is not empty (Theorem 5.2-B); hence the degree of 
P(A) is at least 1, for o(T) is precisely the set of singular points of R, i.e., 
the set of zeros of P(A). It now follows from Theorem 5.9-A that 
P(T) = 0. Suppose, on the other hand, that P(A) is some polynomial of 
degree > l1 such that P(T) — 0. By Theorem 5.9-A we know there 
exists a polynomial g(A) (with coefficients in [X]) such that (5.9-1) holds 
when à € p(T). It remains to show that there exist polynomials P, and 
qı such that p(T) = (A: P,(À) # 0}, P, and q, have no common zeros, and 
R, = q(A)/P,(A). It is not necessarily true that we can take P, = P 
, and q, = q. 

If ào € p(T) and if Ap is a common zero of P and q, its multiplicity m 
as a zero of P is the same as its multiplicity n as a zero of q. For, if we 
let r = min (m, n), divide both sides of (5.9-1) by (A — Ag)’, and let 
À — As, we get a contradiction unless m = n (observe that R, # 0 when 
À € p(T), as a result of our standing assumption that X has at least two 
elements). Now let Pg and go be the polynomials obtained from P and 
q respectively, by removal of the factors arising from common zeros in 
p(T). Then P(A) has no zeros in p(T) and 


qo) 
(5.9-2) R, = Po) 
if A € p(T). 

Next we show that e(T) is precisely the set of zeros of Po(A). If 
m = {A: P(A) # 0}, we know that p(T) C v. Now ~ is connected and 
p(T) is open, so that, if 7 — p(T) were nonempty, it would have to contain 
an accumulation point of p(T), say «. Let A = qo(@)/Po(«). If (A(n)) is 
a sequence in p(T) such that A(n) — a, we see from (5.9-2) that Rim — A. 
From this we easily conclude that A(« — T) = (« — T)A = J, so that 
« € p(T) and A = R, We must therefore have m = p(T). 

Now, finally, there may be common zeros of Py and qe not in p(T). 
However, the multiplicity of such a zero for Py must exceed its multiplicity 
for qo, for a contrary assumption would lead us to the conclusion that the 
zero is in p(7), by an argument like the foregoing. For each such zero 
B, of multiplicity n as a zero of qo, let us divide PQ(4) and go(A) by: 
(A — By. Let P,(A) and q,(A) be the polynomials which result from 
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P(A) and go(A) after the elimination of all such factors (A — By. Then 
P, and q, have no common zeros, o(T) is precisely the set of zeros of P4, 
and R, = q((A/P,(À). This shows that R, is a rational function, and 
completes the proof of the theorem. 

The foregoing proof shows that, if P(T) = 0, then P(A) is divisible by 
the denominator P,(A) of the rational function R, Hence, if R, is 
rational, with distinct poles A,, ---, A, of orders ni, +--+, Mp, among all 
polynomials P(A) of degree > 1 such that P(T) = 0 there is a unique one 
of lowest degree with leading coefficient 1, and this unique one is 


(à — Apm --- (à — Agr. 


This polynomial is called the minimal polynomial associated with T. We 
recall from Theorem 5.8-A that m; is the ascent of A; — T. 
For finite-dimensional spaces we have: 


Theorem 5.9-C. Suppose X is of finite dimension n(n > 1) and that 
Te[X]. Then R, is rational. 


PROOF. We deliberately avoid the use of determinants. Let us write 
T(A) = à — T. The ascent and descent of T(A) must be finite, because of 
‘the finite dimensionality. They are equal, by Theorem 5.41-E. If the 
ascent is 0, then à € p(T); otherwise Ae Pe(T). Now, eigenvectors 
corresponding to distinct eigenvalues are linearly independent (see the 
first part of the proof of Theorem 5.5-G). Hence, since X is n-dimensional, 
o(T) cannot contain more than n points. We know that o(T) is not 
empty. Let the distinct points of o(T) be A,, +++, Ax, and let the ascent 
of T(A,;) be m;. We define P(A) = (A — A,)™---, (A — A,)m™. Select any 
x #0. Since X is n-dimensional, there exist scalars «o, «1, © - -, o, (perhaps 
depending on x) not all 0, such that «gx + a7Tx + +- + o, T?x = 0. 
Let Q(A) = ap + jà +--+ + aà", and let the factored form of Q be 


o(A — Bii --- (4 — B,)r, where fj, ---, 8, are the distinct zeros, and 
« X 0. Then 
(5.9 3) 7 (T= byi- -- (T — Byx-0. 


From this we propose to conclude that P(T)x = 0. For any f; that 
is not one of the points A,, - - *, A, we can omit the factor (T — Bj)'i from 
(5.9-3) without impairing the equality, because (T — f;)"i has an inverse 
in this case. On the other hand, for any A; that is not one of the points 
Bi, +--+, B, we can insert the factor (T — Aj)"; in (5.9-3) without destroying 
the equality. It remains to consider the case of a 8; which is one of the 
points Àj, ---, A,. For simplicity of notation suppose f, = A, If 
vı < m, we can evidently replace v, by m, in (5.9—3), and the equation 
will still hold. The same is true if m, < vj, the reason being that 
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An] = AW T(Í)m] in this case, because m, is the ascent of 8, — T. 
It is now clear that P(T)x — 0. But then P(T) = 0, since P(T) is 
independent of x and x was arbitrary. Hence R, is rational, by Theorem 
5.9-B. 

We now turn to some general considerations which will lead us to a 
result about reducibility in the case of operators for which R, is rational. 
We shall obtain in a more elementary way a result which is obtainable 
from Theorems 5.7~A and 5.8-A. In the immediately following theorem 
no topology is needed. 


Theorem 5.9-D. Let X be any complex linear space, and suppose T is 
a linear operator on X into X. (a) Let P,(A) and P,(d) be scalar poly- 
nomials without common zeros. Let P(A) = P,(A)P2(A), and let Mj, M3, 
M be the null manifolds of P(T), PAT), P(T) respectively. Then 
M,A M; = (0) and M = M, D Ma. (b) Let X, +++) A, be distinct 
complex numbers, and let m,, +++, my be positive integers. Let P(A) = 
(A — Ami ++ (A — Arm. Let Mj be the null manifold of (T — Ajyni, and 
let M be the null manifold of P(T). Then Mi, :-:, My, are linearly 
independent, and M = M,@---@ Mpe 


PROOF. (a) Since P, and P, are relatively prime, there exist polynomials 
Q, and Q; such that 


Q10)P10) + Q20)P20) = 1 


and hence 

(5.94) Q\(T)P;(T) + QXT)PXT) = I. 

It follows that 

(5.9-5) QiCD[P()P. + QXT)PG) = P(T). 


From (5.9-4) we see that M, O M; = (0). Now suppose x € M, and let 
y= OMT)P(T)x. Then (5.9-5) shows that P,(7)y = Pi((T)x, or 
y—xeEM,. Also, P(T)y = Qi(T)P(T)x = 0, so that ye M, Then 
x = (x — y) + y shows that M c Mı ® Mə. Itis evident that M; c M 
and M; — M, and hence M = M, M;. This finishes (a). The truth 
of (b) follows from (a) by induction. 

We now revert to the case in which X is a complex Banach space and 
Te [X]. 


Theorem 5.9-E. Suppose R, is rational, with P(A) = (A — Ayym-- 
(A — Ax)" the minimal polynomial for T. Then, in the notation of Theorem 
5.9-Db, X = M, ®---@®M,, and T is completely reduced by (Mj, 
++, Mj). 
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PROOF. The fact that T(M;) C M; is evident from (T — A) T = 
T(T — à)", and M = X, because P(T) = 0. 

The direct-sum decomposition of X described in Theorem 5.9-E 
determines projections Æ; defined by E;x = x; if X = X, +--+ + Xy 
x; € M;. The projection E; may be described as the residue of R, at the 
pole Àj; it is the projection associated with the spectral set (Aj). Let 


N- b (T — ÀJE, 
i=l 


and let p = max (mı, ---+, m,). It is easily seen that 
k 
NP = (T — 4,)PE; = 0, 
2 


so that N is nilpotent. (Observe that N = 0 if m, =: = m = 1.) 
We can write 


k 
(5.9-6) T = >. XE, 4- N. 
f=] 


‘This representation of T is a consequence of the fact that R, is rational. 
There is a converse to this, as the following theorem shows. 


Theorem 5.9-F. Suppose X is a complex Banach space. Let E}, >>>, 
E, be elements of [X] which are projections such that E;E; = 0 if i # j, 
and | = E, +--+ Ep Let T be defined by (5.9-6), where dy, +++, A 
are complex constants, and N is a nilpotent member of [X] such that 
NE; = EN for each i. Then R, is rational. 


PROOF. Suppose NP» = 0. Now, (T — A)E; = NE;, as we see from 
(5.9-6). Hence(T — Aj)PE,; = NPE; = 0. It now follows from I = E, + 
eo OE, that (T — Ape---(T— A,r = 0. Therefore, by Theorem 
5.9-B, R, is rational. 


PROBLEMS 


l. Let X be n-dimensional and suppose Z€[X]. Let ui, ---, u„ be a basis 
for X, and let D(A) be the determinant of the matrix corresponding to A — T 
when this basis is used. Then D(T) O0. (This is the Hamilton-Cayley 
theorem.) Use Theorem 5.9~A and Cramer's rule. See problem 6 also. 

2. Suppose that R, is rational, and adopt the notation of Theorem 5.9-E 
and Theorem 5.9-Db. Let N; be the null manifold of A; — T, and let Y be 
the subspace generated by N,U---UN,. Then Y= X if and only if 
m=: -e = m=. 
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3. Suppose that R, is rational. Using the notation of Theorem 5.9-E and 
the paragraph which follows it, show that, if f is locally analytic on o(T), 


k mj—l 


Rec 2 £79 qr - Ay, 


In particular, suppose m is fixed, 1 < m « k, and let f(A) be a polynomial such 
that /UXA;) = 1 if i = m, j = 0, while fW(A;) = 0 otherwise as it occurs in the 
formula for f(T). Then f(T) = Em. Since a polynomial of this kind exists 
(of degree at most m, +--+ + m, — 1), each Em is expressible as a polynomial 
in T. See Hamburger and Grimshaw, 1, page 111. 

4. Suppose T € [X] and that X, = &(T) is finite dimensional, but X, 4 X. 
Then 0 &ea(T). Observe that T(Xo) C Xo. Let To be the restriction of T to 
Xo, and let S, be the resolvent of Tọ. In order to see how to express A, in 
terms of S,, write y = Ax ~ Tx, Ty = ATx — To(Tx), whence Tx = S,Ty if 
A¢o(Tp). Then y = Ax — S,Ty, and x = A-!U/ + S,T]y. This suggests that 
R, = AIU + S,T] and that o(T) = (0) v oe(T9. Verify that this is correct. 
Observe that R, is rational, since S, is. An important type of operator with a 
finite-dimensional range is an integral operator with "degenerate" kernel 
kls, 1) = ODP + +++ + e BO. 

5. If X is finite dimensional, formula (5.9-6) plus certain well-known facts 
about nilpotent operators provide the basis for obtaining the Jordan normal form 
matrix representation of the operator T. Choose a basis uj, -+-, u, for X in 
such a way that successive sets of ws form bases for Mi, ---, Mp. Then the 
matrix representation of T takes the form shown here in the adjacent diagram, 


where the only nonzero elements are inside the shaded blocks. The ith block, 
counting down the diagonal, is the matrix representation of the restriction of 
T to M;. Owing to the nilpotency of N, whose restriction to M; is the same as 
that of T — Aj, the basis for M; may be chosen in such a way that the matrix 
representation of the restriction of N to M; has no nonzero elements except 
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for the possibility of 1’s in a certain arrangement along the diagonal directly 
below the main diagonal. There will be some such 1’s if m; > 1, but not if 
mj = l1. Thus the matrix for T has 


down the main diagonal, where v; is the dimension of M;. The only other 
nonzero elements are the 1’s already referred to, on the diagonal just below the 
main diagonal. For more details on the matrix representation of nilpotent 
operators see Halmos, 1, pages 164-165. 


6. Using the results in problem 5, show that the determinant D(A) in problem 
Lis (A — Apr +++ (A — Ages. 
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SPECTRAL ANALYSIS 
IN 
HILBERT SPACE 


6.0 Introduction 


The principal aim of this chapter is to study the more elementary 
properties of symmetric linear operators (also called Hermitian operators 
if the scalar field is complex) and especially the properties of self-adjoint 
and normal operators in Hilbert space. The theory of compact symmetric 
operators is developed without requiring the space to be complete. This 
material has applications to the Hilbert-Schmidt theory of integral 
equations with symmetric kernel and to symmetric differential operators 
with compact resolvent; in particular, to the classical Sturm-Liouville 
differential-equation problems. The spectral theorem is proved for 
bounded self-adjoint operators and for unitary operators. The state of 
affairs for unbounded self-adjoint operators is sketched without 
proofs. 

The “big” theorems of the chapter are: 6.4-B, 6.4-C, and 6.4-D for 
compact symmetric operators; 6.5-A and 6.5-C for the spectral theorem 
for bounded self-adjoint operators and the operational calculus founded 
on it; and 6.5-B, the spectral theorem for unitary operators. Theorems 
6.5-D and 6.5—E are of fundamental interest, since they relate the spectral 
classification of a point (in relation to a bounded self-adjoint operator) 
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to the function-theoretic character of the resolution of the identity at 
that point. 

Theorem 6.2-C, comparatively simple in itself, is of crucial importance 
in the proof of Theorem 6.5-A. 


6.1 Bilinear and Quadratic Forms 


Throughout this section X denotes a not necessarily complete inner- 
product space. The scalar field may be either real or complex, except 
when we specify one or the other explicitly. If no such explicit speci- 
fication is made, a bar indicating the complex conjugate of a number is 
to be ignored if the situation under consideration is being regarded from 
the point of view of real scalars. 

Suppose A is a linear operator with domain X and range in X. Then 
the inner product (Ax, y) is a linear functional of x for each fixed y. As 
a function of y, (Ax, y) is linear when the scalar field is real; in the 
complex case, however, we do not quite have linearity with respect to y, 
for (Ax, ay) = &e(Ax, y), the scalar factor coming outside as & rather than 
asa. However, for convenience in embracing both the real and complex 
cases in one terminology, we shall say that (Ax, y) is bilinear in x and y. 

For some purposes it is desirable to study bilinearity directly, instead 
of through the medium of alinear operator. Hence we make the following 
definition: A scalar-valued function ¢ on X x X is called a bilinear form 
if (x, y) is linear in x for each y, while 4(x, y) is linear in y for each x. 
With $ we associate the functional y on X defined by y(x) = ¢(x, x). 
We call $4 the quadratic form corresponding to 4$. Observe that 

Max) = Jalpa). 


One important relation between $ and y is expressed by the formula 


(1-2) — 360.» + 40,9) = (522) - (E22 


It may be verified by expanding the terms on the right, using the 
bilinearity. When the scalar field is complex we have 


(61-2) 406.) = (552) - (552) + AS) - oS), 


In the complex case, therefore, ¢ can be expressed entirely in terms of y. 
This is not always true in the real case, however, for in this case the left 
member of (6.1—1) is a bilinear form, in general not the same as $, whose 
corresponding quadratic form is the same as the one corresponding to 9. 

A bilinear form ¢ is continuous jointly in its two variables if and only 
if |6(x, y)| is bounded for all x and y such that ||x|| < 1, ||y|| < 1 (proof 
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similar to that of Theorem 3.1-A). When ¢ is continuous we define 


TENE I(x, y)| 0 0 
lij] = sup Ici DAT (for x # 0, y 4 0), 


or, equivalently, we may take the supremum merely for all x and y with 
lix] = ||yll = 1. To avoid trivialities we are assuming that the space X 
does not reduce to (0). For the corresponding quadratic form we define 
263] 

I = = $ L e 

(ij = sup 69] = sup Tez 
Obviously |\y!| < ll]. When the field of scalars is complex it is easily 
seen with the aid of (6.1-2) and (4.81-1) that |ié]] < 2)|p/|. Hence 


(6.1-3) Iii < leil < 209] 


in the complex case. 

A bilinear form ¢ is called symmetric if $(x, y) = ¢(y, x) (in the 
complex case such a form is also called Hermitian). If ¢ is symmetric we 
can prove that 


(6.1-4) ligii = Il. 
We have only to prove that ||d]| < |j]. Owing to the symmetry we have 
from (6.1-1) and (4.81-1): 

[Re g(x, y)| < 3l Qoi? + lvl) 


(with the Re symbol, for the “real part," superfluous in the réal case). 
For fixed x and y with |x| = ||y|| = 1 we can choose « so that |«| = 1 
and a(x, y) = |d(x, y)], whence 2 


la y)| = lex, y) = [Re lex, »)| < llli, 
and so |/¢|| < jJ. 
Theorem 6.I-A. Suppose ¢(x, y) = (Ax, y), where A is linear on X 


into X. Then $ is continuous if and only if A is continuous, and then 


|All = lil. 


PROOF. If A is continuous, |(Ax, y)| < ||Ax'l liyi < IAIL lxil yl. If $ 
is continuous, ||4x|? = (Ax, Ax) < ll$il lixll LAxIl, or [Axil < [igi (ixi. The 
conclusions now follow. 


Theorem 6.1-B. Suppose that X is complete and that $ is a continuous 
bilinear form. Then there exists A € [X] such that $(x, y) = (Ax, y). 


PROOF. For fixed x, (x, y) is a continuous linear functional of y. 
Hence, by Theorem 4.81—C, we can represent the functional in the form 
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(x, y) = (y, Ax), where Ax is some vector depending on x. This 
defines an operator A on X; the linearity of A is easily verified, since 
(Ax, y) = (x, y). That A is continuous follows from Theorem 6.1-A. 


PROBLEM 


Suppose A is linear on X into X, where X is a complex inner-product space. 
Then, if (Ax, x) = 0 for each x € X, it follows that A = 0. Is this true for 
real inner-product spaces? 


6.11 Symmetric Operators 


A linear operator A with domain and range in the inner-product space 
X is called symmetric if 


(6.11-1) (Ax, y) = (x, Ay) 


for each x and y in Z(A). In case X is a complex space, a symmetric 
linear operator is also called a Hermitian operator. If we regard Z(A) 
by itself as an inner-product space, ¢(x, y) = (Ax, y) is a bilinear form 
on GA) x Z(A), and ¢ is symmetric (as defined in § 6.1) if and only if 
A is symmetric. The corresponding quadratic form, defined on Z(A), is 
(Ax, x). 

We assume that A is symmetric, with Z(A4) # (0). Then (Ax, x) is 
real, even when X is a complex space, and we define 
(6.112) m(A) = inf (Ax, x), M(A) E (Ax, x). 


lxi 
The possibilities (4) = — oo, M(A) = + oo are not excluded. 


Theorem 6.11-A. Jf A is symmetric and 2 is an eigenvalue of A, then 
à is real, and m(A) < A < M(A). Eigenvectors corresponding to distinct 
eigenvalues are orthogonal. 


PROOF. Suppose |x| = 1 and Ax = Ax. Then (Ax, x) = (Ax, x) = A, 
so A is real and m(A) < A < M(A). If Ax = Ax and Ay = py, where 
AF H, We have (x, y) = (Ax, y) = (Ax, y) = (x, Ay) EN (x, By) = Hx, y), 
or (A — p(x, y) = 0, whence (x, y) = 0. 

Next we consider the question as to whether the bounds m(A) and M(A) 
can be attained by values of (Ax, x) when |x| = 1. If A = m(A) happens 
to be an eigenvalue of 4, there is an x with ||x|| = 1 and Ax = Ax. Then 
(Ax, x) = (Ax, x) = m(A). A similar thing is true if M(A) is an eigen- 
value. There is a valid converse if Z(A) is dense in X. 
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Theorem 6.11-B. Suppose that A is symmetric and that ZA) is dense 
in X. Suppose y € Z(A), |\yl| = 1, and (Ay, y) = A, where à is either 
m(A) or M(A). Then Ay = dy, so that À is an eigenvalue of A. 


PROOF. Suppose for example that A = m(A). Let B= 4 — X. Then 
B is symmetric, with (By, y) = 0 and m(B) = 0, so that (Bx, x) > 0 for 
every x in ZA). Let a = 6(By, x), where x is arbitrary in Z(A) and 0 
is an arbitrary real number. Then 
O < (Bly + ax], y + ax) = (By, y) + of Bx, y) + a(By, x) + |a[ (Bx, x), 
or 

0 < 6|(x, By)|7{2 + (Bx, x)}. 
Since the right member of the inequality changes sign with @ when @ is 
small, unless (x, By) = 0, we conclude that (x, By) = 0. This is true for 
each x € Z(A), and, since Z(A) is dense in X, we conclude that By = 0 or 
Ay = dy. If A = M(A), we put B = à — A, and the same argument 
applies. 

When X is complete and 4 is symmetric, with Z(4) = X, we can prove 
(see $6.2) that A is continuous and that o(A) lies on the interval 
m(A) < A < M(A) of the real axis, with m(A) and M(A) actually belonging 
to o(A). 

In the next theorem we consider the situation in which Z(A) = X, 
though X need not be complete. 


Theorem 6.11-C. If A is symmetric, with Z(A) = X, then A is 
continuous if and only if m(A) and M(A) are both finite, and in that case 
(6.11-3) |A| = max {|m(A)|, IMA) 

PROOF. We know from Theorem 6.1-A that A is continuous if and 
only if |(Ax, y)| is bounded for all x and y for which [xj = |j»|| = 1; 
and, as we see in conjunction with (6.1—4), this is the same as demanding 
that sup |(Ax, x)| be finite, this supremum then being equal to ||A||. 

ixi 1 
Formula (6.11—3) now follows from the definitions (6.11—2). 


Example 1. Let X be the Hilbert space L?(0, 27). Let ZA) be the 
Subspace of X determined by those functions x(f) which are absolutely 
continuous on [0, 27], such that x(0) = x(27) and such that the derivative 
x'(f) is of class .72(0, 27). For x €Z(A4) define Ax = y to mean 
y(t) = — ix' (t). Then A is symmetric. For, if x, y € BA), 


i Feo} = OV] + OPO. 
and so 


0 = ix(ny() = (x, Ay) — (Ax, y). 
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Example 2. An important type of symmetric operator arises in 
connection with certain boundary-value problems for second-order 
ordinary differential equations. The symmetry of the operator in such 
problems depends both on the nature of the boundary conditions and on 
certain formal properties of the differential operator which occurs. The 
space X is taken to be either L?(a, b) or some subspace of L(a, b), with 
the usual inner product of L?(a, b). When the domain Z(A) is suitably 
defined, Ax — u is expressed by 


(6.11-4) u(t) = — IOLO + oxo 


where p and q are certain real-valued functions. This formula exhibits 
the essential formal structure of the differential operator. There must be 
conditions on p, q and ZA) which insure that Ax is a well-defined member 
of X when x €G(A). For instance, if (a, b) is a finite interval and if X 
consists of those elements of L7(a,b) which correspond to functions 
continuous on [a, b], we might require q to be continuous and p to be 
continuously differentiable. We could then take Z(4A) to consist of those - 
functions which are twice continuously differentiable and satisfy certain 
boundary conditions. If X is taken to be all of L?(a, b), we might require 
that q be measurable and bounded and that p be absolutely continuous. 
Then Z(A4) could be taken to consist of those elements of L?(a, b) 
corresponding to functions x(r) which are such that both x(f) and 
p(t)x’(t) are absolutely continuous, p(t)x' (t) has a derivative of class 
-Z?(a, b), and x(t) satisfies certain boundary conditions. 
If Ax — u and Ay — v, it is easily verified that we have 


uy) — xt) = FOOD - x VOD. 
Thus 
(Ax, 9) = (5 49) = pO — x OMT). 


The operator 4 is then seen to be symmetric, provided that the definition 
of YA) insures that 


(6.11-5)  pD)[x (by (b) — xO] = AATA) — xA]. 


In case the interval is infinite, this condition must be interpreted appro- 
priately. For a finite interval the boundary conditions are of the form 
«14X(a2) + e12x'(a) + Buix(b) + Biox' (b) = 0 
&2,X(a) + «55x'(a) + B21x(5b) + Bz2x'(b) = 0 
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where the o's and f's are certain real scalars. For these boundary 
conditions it can be shown that condition (6.11—5) is equivalent to the 
condition 


Bir Biz 
£a P22 


It is not our intent in this book to discuss in detail the spectral analysis 
of a symmetric operator A of the type just described. However, in 
$ 6.4, as an application of the theory of compact symmetric operators, we 
do discuss the solution of boundary-value problems of this type in the 
special case in which 4-1 is a compact operator belonging to [X]. 

We return now to the general consideration of symmetric operators. 
Suppose 4 is symmetric, and that (Ax, x) 2 0 for each x € D(A). Let us 
write (x, y) = (Ax, y). Then (x, y}, as a function on BA) x Z(A), has 
all the properties of an inner product except possibly the property that 
(x, x) — 0 implies x — 0. This last property is not needed in the 
derivation of the Schwarz inequality |(x, y}|? < (x, x}{y, y}, however 
(see Theorem 3.2~A), and so we obtain the inequality 


ej 912] 


(6.11-6) pla) = p(b) 


«2, 02? 


(6.11-7) |(Ax, y| <S (4x, x)(Ap, y) x,y e GA) 


under the stated conditions on A. This result is used in the proof of 
Theorem 6.2-B. 


PROBLEMS 


l. Let A be linear on X into X, where X is a complex inner-product space. 
Suppose (Ax, x) is real for every x. Then A is symmetric. Use (6.1-2). 

2. Suppose A is linear on X into X and symmetric. Then, if (Ax, x) = 0 for 
each x, it follows that A = 0. Compare with the problem at the end of § 6.1. 


6.12 A Theorem of Schur 


A bounded linear operator A with domain /? and range in 7? is repre- 
sentable by an infinite matrix («;;); see Example 5, 8 4.2 and problems 3 
and 4, $4.51. There is a useful theorem, due to I. Schur, 1, which gives 
conditions on an infinite matrix sufficient to insure that it defines an 
element A of [2]. Schur's theorem also gives an estimate of ||A||. The 
proof makes use of some facts about symmetric operators in finite- 
dimensional spaces. 
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Theorem 6.12-A. Let («;;) be an infinite matrix of scalars such that 


(6.12-1) D lest < Mm, i=l, 
j=l 

and 

(6.12-2) 2 lel My, j-2L2,-- 
i-i 


Then the matrix represents an operator A on I? to [2 such that 
(6.123) lAl < (MM3. 


PROOF. From (6.12-2) it is clear that > |a,;|2 < œ foreachj. Hence 
k 


the series 
eo 
= > [27177] 
k=1 
is convergent. Now consider the linear operator B, on /?(n) defined by 


= > Bib, i= lee, n. 
j=l 


That is, B, maps x = (é, ---, é) into y = (gi ***, 7). The inner 
product of B,x and x is 


(B,x, x) = > 2 Byg: = > 2 » «y; y EE; 
n 2 
> Cu 4 


or 


(6.12-4) (B,x, x) = > 


Observe that B, is symmetric, because £;; = B; The eigenvalues of 
B, are nonnegative, since (B,x, x) > 0. Suppose A is an eigenvalue, say 
B,x = Ax, where x = (f ---, &,) #0. Let |&,| be the largest of the 
values |£;|,---, |é,|. Then 


Ép = S bus Alé] & 5 (85; £l. 
j=l j=l 


a< Š Il = 2 > uie 
"T [eal bul < MiM;. 


and so 


? 
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Now, the largest eigenvalue of B, is given by 


A = max (B,x, x); 
ixi 1 


we know this from Theorems 6.11-À, 6.11—B. We have thus proved that 
(B,x, x) < M,M; if |x| = 1, which implies that 


(B,x, x) < M,M> > (|? 
j=1 


2 ee} 


for arbitrary (€),---+, é). In view of (6.12-4) we infer that 
< MiM2 ME? 


oo oo 
> > ety 8; 
i=l j=l 


k=1 
for each vector x = {é} in /2, This proves (6.12-3). 
The inequality (6.12-3) is a special case of the result of problem 1, 
$ 4.52. 


6.1 Normal and Self-adjoint Operators 


Throughout this section X denotes a complete inner-product space, and 
all of the operators which we consider in the theorems belong to [X]. 
We assume X # (0). If Ae[X], then A* €[X] also (see $4.9); the 
definition of A* is fully expressed by the relation 


(6.2-1) (Ax, y) = (x, A*y) x, yeXx, 


We recall from § 4.9 that A is called normal if AA* = A*A, and self-adjoint 
if A = A*. We seethat a self-adjoint operator is symmetric. Conversely, 
a symmetric operator whose domain is all of X (with X complete) must 
be self-adjoint. The proof of this fact hinges upon the closed-graph 
theorem, or alternatively, upon the principle of uniform boundedness. 
See problem 1 at the end of this section. For a related matter in a more 
general setting see problem 1, § 4.5. 

There is a generalization of the definition of self-adjointness, so that 
certain unbounded operators with domains dense in X are called self- 
adjoint. These operators are symmetric, but not all symmetric operators 
are self-adjoint in this extended sense. See § 6.7. 

If X = La, b) and if K is an operator defined by an ¥2-kernel K(s, t), 
the adjoint K* is defined by the kernel k(t, s). In this case, therefore, 
K is self-adjoint if and only if k(s, 1) =° k(t, s). 

If X = P and if A € [7] is represented by the infinite matrix («;,), the 
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adjoint is represented by (&;;) (i.e., the conjugate of the transposed matrix). 
Hence A = A* means that «,; = ä;; for each i and j. . 

Our first theorem concerns the localization of the spectrum of any 
member of [X]. 


‘Definition. If A € [X], let V(A) be the closure of the set of values of 
(Ax, x) for all x with |xi| = 1. 


Theorem 6.2-A. Jf A €[X], o(A) < V(A). If the distance d from A 
to V(A) is positive, then 


(6.2-1) (A — AA] < d. 


PROOF. Suppose A is not in V(A), the distance from A to V(A) being 
d>0. Then |(Ax,x) - A[ 2 d if |x| = 1. We can write this as 
[CAx, x) — A(x, x)| = (4x — Ax, x)| > dif |ixl| = 1, whence |(Ax — Ax, x)| 
> d|x|? for every x. But then d|xj? < ||Ax — Ax[|]xi, or diixi| < 
[Ax — Axl. This shows that (A — A)! exists and is continuous, with 


(6.2-2) (A — A) yl] < diyil 


for every y in the range of à — A. We know, then, that A is either in 
p(A) or Ro(A). It remains only to show that A cannot be in Ro(A). 
Now, if A € Ro(A), the first of the relations (4.9-6) shows that the null 
space of (A — A)* = À — A* contains a nonzero vector, i.e., that A is an 
eigenvalue of A*. Suppose !xl = ] and A*x = Ax. Then (Ax, x) = 
(x, A*x) = (x, Ax) = A, so that AG V(A). This contradiction finishes 
the proof. 

It can be shown that V(A) is a convex set (see Stone, 1, pages 130-133). 
In the case when A is normal, V(A) is the smallest closed convex set 
containing o(A) (see A. Wintner, 2, page 248, and Stone, 1, pages 327- 
328). For finite-dimensional spaces these results go back to Toeplitz 
and Hausdorff; see Wintner, 1, pages 33-38. 


Theorem 6.2-B. Suppose A is a bounded self-adjoint operator. Then 
c(A) lies on the closed interval [m(A), M(A)] of the real axis. The end 
points of this interval belong to o(A). 


PROOF. The first assertion is a consequence of Theorem 6.2-A, for it 
follows from (6.11-2) that V(A) lies on the closed interval in question. 
(In fact, V(A) is the closed interval [m(A), M(A)], as a result of the fact 
that V(A) is convex; but we do not need this information.) To see that 
m(A) is in o(A) let A = m(A) and observe that (L4 — A]x, x) > 0 for each 
x. Therefore, by (6.11—7), with A — A, x, and (A — A)x in place of A, 
x, and y respectively, we have 

((4 — A)xi* < (4 — Apo xX[A — APx, [4 — A) 
< ([A — A], x) l4 — APIIxI". 
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If [4 — All = O it is clear that Aco(A). Otherwise we see from the 
foregoing that 


inf |(4 — A)x|| = 0, 
bx 1 


whence A € o(A). Thisis because inf ([4 — A]x, x) = 0, by the definition 


ixii-1 
of m(A). The proof that M(A) is in o(A) is similar. 

If à is not on the interval [m(A), M(A)] we can estimate the norm of 
(A — A)-! in terms of the distance from A to the interval, using (6.2-1). 
In particular, if X is a complex space and A is not real, the distance in 
question is not less than the absolute value of the imaginary part of A. 
Hence 


(6.2-3) IA — 4)7tll < 2//4 — Xl. 


Theorem 62-C. Jf A &[X] and A = A*, the spectral radius of A is 
LAT. 


PROOF. This is an immediate consequence of (6.11-3) and Theorem 
6.2-B. 

This result, which is of crucial importance in our proof of the 
fundamental spectral theorem for self-adjoint operators (Theorem 6.5-A), 
can be proved in other ways (see problem 2). The property is true, more 
generally, of normal operators in complex spaces, as we shall see presently. 


Theorem 6.2-D. Jf A € [X], A is normal if and only if ||Axi| = ||A*x|| 
for every x. 


PROOF. We have 
||Ax||2 = (Ax, Ax) = (x, A* Ax), 
and 
llA*x||? = (A*x, A*x) = (x, A** A*x) = (x, AA*x). 
Thus ||Ax]]  ||A*x|| if and only if (x, A*Ax) = (x, AA*x). But this is 
true for every x if and only if 4*4 = AA*. For, wecan set B = A*A — 


AA*, and then B* = B. The desired result now follows by noting that 
(Bx, x) = 0 for all x is equivalent to B = 0. See § 6.11, problem 2. 


Theorem 6.2-E. Jf the space is complex and A is normal, the spectral 
radius of A is exactly ||A|. 


PROOF. We first prove that ||A2|| = ||4]2. We have ||4?x|| = ||A*Ax|| 
for every x, by Theorem 6.2-D. Thus ||A?|| = ||A* Al. But we know 
that ||4* A|| = ||A||2 (by Theorem 4.9-B). Since powers of A are normal, 
it now follows by induction that ||A?\| = ||All? if p is a positive integer of 
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the form 2”. The fact that the spectral radius of A is ||4|| now follows 
from Theorem 5.2-E. 
Next we consider the ascent of a normal operator. 


Theorem 6.2-F. Jf A is normal, its ascent is either 0 or 1. 


PROOF. We give the proof first on the assumption that A = A*. If 
x € W(A?), we have 0 = (A2x, x) = (Ax, Ax), whence Ax — 0. We 
conclude that (A?) < W(A), whence (A?) = (A), and the ascent 
of A does not exceed 1. For the case of an arbitrary normal 4, let 
B = AA* = A*A,sothat B* = B. Ifx e (A2), then B2x = (AA*)2x = 
(A*)?42x = 0. Hence Bx = 0, by the first part of the proof. Then 
0 = (A*Ax, x) = (Ax, Ax), or Ax =0, and so W(A2) = (A), as 
before. This finishes the proof. 

We also have: 


Theorem 6.2-G. If A is normal, &(A) and N(A) are orthogonal 
complements, so that X = (A) © .W(A). 


PROOF. We know from Theorem 6.2-D that (A) = W(A*). We 
then see from (4.9-6) that (A) = (A), and the result follows from 
Theorem 4.82-A. 

Now suppose that X is a complex space. If A is normal, so is A — A. 
Let R, be the resolvent of A when A& p(A4). If àis a pole of R, it 
follows by Theorems 5.8-A, 6.2-F, and 6.2-G that the pole is of first 
order, that Z(Ay — A) is closed and that A(Ay — A) and A (A, — A) are 
orthogonal complements. In this case, of course, Ag is an eigenvalue of 
A. Conversely, suppose that A is normal and that #(àọ — A) is a closed 
and proper subspace of X. Then, by Theorem 5.8-D, A, is a first order 
pole of the resolvent of A. 

If X is complex and finite dimensional and if A is normal, with the 
distinct eigenvalues Àj, ---, A,, the ascent of A; — A is 1 for each i (by 
Theorem 6.2-F). If M; is the null manifold of A; — A, it follows that 
X= M, Q--- Q M, and that A = A,E, + ---  ALE,, where E; is the 
projection of X onto M; determined by this particular direct sum 
decomposition of X. The reader is referred to Theorem 5.9-E and formula 
(5.9-6); in this case V = 0. The null manifolds Mj, - - -, M, are mutually 
orthogonal (see problem 8). We have here a special case of the spectral 
theorem for normal operators. 


PROBLEMS 


I. Suppose 4 and B are linear on X into X and that (Ax, y) = (x, By) for all” 
xand y. Then 4 e[X] and B = A*. One method of proof starts by showing 
that A is closed, whence A ¢{X]. Another method: |(Ax, y| = Kx, By) < 
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lixl| ||Byll < ||Byl| for each y if [|x| 1. Then A is continuous, by the principle 
of uniform boundedness. 

2. If Ac (X] and A = A*, prove that r,C4) = |All, starting as follows: 
Let œ = |All. Show that 

l(a? — A2)x\|2 = afixi? — 2e2iAxII? + |L4?x]i7. 
Choose x, so that |x,| = 1 and [||4x,] — Ilil, and deduce that o? € o(A2). 
Explain why either « € o(A) or — « € o(A), and finish the proof. 

3. If A is normal, so is A — A. 

4. Suppose A and B are normal and that AB* = B*A. Then A*B = BA*, 
and AB, BA, and A + B are all normal. 

5. If A € [X], we can write A in the form A = H + iK, where H and K are 
self-adjoint, in one and only one way, namely with H = !/,(A + A*), 
K = (1/2i(4 — A*). Then A is normal if and only if HK = KH. 

6. Suppose A e [X]. Then (a) A € p(A) if and only if À € p(A*); (b) A € Co(A) 
implies À € Co(A*); (c) À € Ro(A) implies A € Po(A*); (d) A € Po(A) implies 
À € Po(A*) U Ro(A*). 

7. Suppose A is normal. Then A is in the resolvent set, the continuous 
spectrum, or the point spectrum of A if and only if À is in the corresponding 
set associated with A*. The residual spectrum of A is empty. Moreover, À 
is an eigenvalue of A if and only if the range of A — A is not dense in X. This 
follows from Theorem 4.9-C, applied to A — A. A proof without recourse to 
the state diagram can be based on the three following facts (for an arbitrary 2): 
(a) 4(À — A) and &A — A*) have the same closure; (b) |(A — A)x/| = 
WA — A*)xt; (0 ZA — AL = WO — A9. 

8. Suppose 4 isnormal. IfAisaneigenvalue of 4 and M is the corresponding 
eigenmanifold, M is also the eigenmanifold corresponding to À as an eigenvalue 
of 4*. Eigenvectors corresponding to distinct eigenvalues of A are orthogonal. 

9. Suppose A is normal and A = H + iK, where H and K are self-adjoint 
and HK = KH (see problem 5). Then A`! exists and belongs to [X] if 
and only if (H2 + K2)-! exists and belongs to [X]. In that case 4^! = 
A*(H? + Ky), 

10. If A is normal, 2(A2 = Z(A). 

ll. If A is normal and its descent is finite, the range of A is closed [use 
Theorem 5.41-G and (5.41-4)]. 


6.3 Orthogonal Projections 


Suppose that X is an inner-product space and that P is a projection 
defined on X. We know that X = Z(P) D (P) (see $4.8. If RP) 
and ./(P) are orthogonal, we say that P is an orthogonal projection. 


Theorem 6.3-A. A projection is orthogonal if and only if it is symmetric. 
PROOF. Write x = Px + u, y = Py + v, with u and vin Jl (P). Then 
(Px, y) = (Px, Py) + (Px, v), 
(x, Py) = (Px, Py) + (u, Py). 
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If Z(P) and ~(P)are orthogonal, we see that (Px, y) = (Px, Py) = (x, Py), 
so that P is symmetric. 

On the other hand, if P is symmetric and x € Z(P), y e V(P), then 
Px = x, Py = 0, so that (x, y) = (Px, y) = (x, Py) = (x, 0) = 0, so that 
P is orthogonal. 


Theorem 6.3-B. 4n orthogonal projection is continuous, and 0 « 
(Px,x) < 1 if xi 2 1l. If 0 z P, then |jP| = 1; if also P + I, then 
m(P) = 0 and M(P) = 1. 


PROOF. By the orthogonality of P, x = Px + u, with (u, Px) = 0. 
Then ||x|? = ||Px||2 + ||uj?, whence ||Px||2 < |x|? and |PJ] < 1. From 
P = P? we see that ||P|| < ||P|?, whence 1 < ||P|| and so ||P|| = 1 if P z 0. 
If |x| = 1, we have (Px, x) = (P?x, x) = (Px, Px) < Pj? < l. Hence 
0 € m(P) and M(P) < 1 [see (6.112). If 0 z P, Px = x can occur 
with x z 0, so M(P) = 1; if P z I, Px = 0 can occur with x # 0, so 
m(P) = 0. 

For symmetric linear operators defined on X it is useful to introduce 
a partial-order relation. If A and B are symmetric and (Ax, x) < (Bx, x) 
for every x, we write 4 < B. This is equivalent to m(B — A) > 0. If 
A <S B, then «A < «B when a > 0, and A + C < B + C for every 
symmetric C. If A < Band B < A, then A = B, by problem 2, § 6.11. 

Observe, by Theorem 6.3-B, that O < P < Z if P is a symmetric 
projection. 


Theorem 6.3-C. Jf P, and P; are symmetric projections, P, < P is 
equivalent to P,P, = P,. In this case P,P, = P,P, and P; — P, is also 
a symmetric projection. 


PROOF. From P,P; = P, we have (P,Px, y) = (Pax, Piy) = (x, P2Pyy) 
= (x, Piy) = (Pix, y), whence P,P; = P,. It is now easy to verify that 
P, — P, is a symmetric projection, whence 0 < P; — Pi, or P, < P». 
Conversely, suppose P; < P5. Then - P; x I- Pj. Let Q, =1-— Py. 
Then Q;— Q, Q2< Qı, QP; =0, and so (Q2P\x, Q2P)x) = 
(Q2P1x, Pix) < (QiP,x, Pix) = 0, whence Q,,P; = 0. This is the same 
as P, — P,P; = 0, or PoP; = P}. 

The foregoing theorem is used in the proof of Theorem 6.5-A. 


6.4 Compact Symmetric Operators 
For this section we assume that X is a real or complex inner-product 


space, with X # (0) Completeness is assumed only as needed. We 
consider an operator A € [X], assuming that it is compact and symmetric. 
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To avoid trivialities we assume A # 0. For the definition of a compact 
operator see $ 5.5. The present section is largely independent of § 5.5. 

The basic fact about the type of operator here considered is that it 
possesses a finite or countably infinite set of nonzero eigenvalues (and at 
least one such eigenvalue); moreover, the structure of the operator can be 
completely analyzed in terms of the eigenmanifolds corresponding to 
these eigenvalues. The exact story is told by Theorem 6.4-B. What we 
have here is a generalization of the fact that, if X is finite dimensional and 
A is a symmetric member of [X], a basis consisting of eigenvectors can 
be chosen for X in such a way that the matrix representing A is a diagonal 
matrix with each diagonal element an eigenvalue. 

The initial step is that of proving the existence of at least one nonzero 
eigenvalue. 


Theorem 6.4-A. Suppose A compact, symmetric, and A #0. Then 
either ||A| or — ||4|l| is an eigenvalue of A, and there is a corresponding 
eigenvector x such that ||x|| = 1 and |(Ax, x)| = |All. 


PROOF. In view of (6.11-2) and (6.11—3) there exists a sequence {x,} 
such that |]x,]| = 1 and (Ax,, x,) — A, where Ais real and |A| = |All]. Now 
0 S l| Ax, = Ax]? = \|Ax,])? a 2A(Ax,, Xn) mU MUX All? 

[AIZ — 2A(4x,, Xn) + 2. 


I^ 


But then we see that Ax, — Ax, — 0. Since A is compact, {Ax,} contains 
a convergent subsequence, which we denote by (4y,], {Yk} being a 
subsequence of {x,}. The sequence {y,} is then convergent also, because 
A #0. Suppose y, — x as k-> œ. Then |x| — 1 and Ay,— Ax, 
whence Ax = Ax. Evidently |(Ax, x)| = |A| llxI? = ||A]], so the proof is 
complete. 

We now apply Theorem 6.4-A repeatedly. Denote the eigenvalue and 
eigenvector of Theorem 6.4-A by A, and x, respectively. Let X = Xj, 
and let X; = {x:(x, xı) = 0}. Then X, is a subspace invariant under A, 
for x € Y; implies (Ax, x1) = (x, Axı) = (x, A1) = A(x, xj) = 0. The 
restriction of A to X; is compact and symmetric. If the restriction is not 
the zero operator, we can assert the existence of A, and x; such that 
X5 € X5, |x] = 1, Ax; = Ax», and JA,| is the norm of the restriction of 
Ato X;. Evidently |A,| < |A;|. Continuing in this way we obtain the 
nonzero eigenvalues A, ---, A,, with corresponding eigenvectors xj, «++, 
x, of unit norm. We also obtain X,, ---, X,41, with Xk+; the set of 
elements of X, which are orthogonal to x1, -- -, xy. At each step x, € X, 
and |A,| is the norm of the restriction of A to Xx, so |] 2 || >- 
> |A,|. The process stops with A,, x, and X,,, if and only if the restriction 
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of A to X,,; 1s 0. In that case the range of A lies in the linear manifold 
generated by x,,---, X„ For, if x € X, let 
(6.4-1) Yn =xX— > (x, x4)X4. 

k=1 
Then (y, xj) 2 0 if i= 1, +++, n, so that y,€ X,,,, and therefore 
Ay, = 0, or 


(6.4-2) Ax = > x,)AX, = > AX, Xp) Xue 
k=1 k=1 


This situation may occur even if X is infinite dimensional. It will 
certainly occur eventually if X is finite dimensional, because xj, ---, x, 
are linearly independent. 

The foregoing considerations lead us to the statement of the fundamental 
theorem: 


Theorem 6.4-B. Suppose A compact, symmetric, and A #0. The 
procedure described in the foregoing discussion yields a possibly terminating 


sequence of nonzero eigenvalues À,, àz, - - - and a corresponding orthonormal 
set of eigenvectors X,, X5, +--+. If the sequences do not terminate, then 
|A,| — 0. The expansion 

(6.4-3) Ax = D(AX, x,)xy = XALX, x)Xi 


is valid for each x € X, the summation being extended over the entire 
sequence, whether finite or infinite. Each nonzero eigenvalue of A occurs 
in the sequence {i,}. The eigenmanifold corresponding to a particular A; 
is finite dimensional and its dimension is exactly the number of times this 
particular eigenvalue is repeated in the sequence {A,}. 


PROOF. Since [A,| > [Axi,|, we either have A, > 0 or || 2 € > O for 
some e and all n. Suppose the latter and that the sequence is infinite. 
Then {x,/A,} is a bounded sequence, and A(x,/A,) = x,, so that (x,) must 
contain a convergent subsequence. This is impossible, for the ortho- 
normality yields ||x, — Xml? = 2. Hence 4, +0 when the sequence is 
infinite. If the sequence of A's terminates with A,, (6.4-3) is equivalent 
to (6.4-2). In the nonterminating case we define y, by (6.4-1) and obtain 


lyd? = lix? — >. Gs xol? < lix. 
k=1 


Since y, € X,,, and |A,4,} is the norm of the restriction of A to X,,,, we 
have 


A¥all < [Anta] [Pall < Dual xil 
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Hence Ay, — 0. But 


Ay, = AX — > (x, Xp )AXk 


k=1 


and so we obtain (6.4-3) [note that Ax, = A,x, and (Ax, x,) = (x, Ax,) = 
Ax, x,)]. 


If A is a nonzero eigenvalue of A which is not in the sequence (Aj, 
there is a corresponding eigenvector x of unit norm, and it must be 
orthogonal to x, for every n, by Theorem 6.11-A. Then Ax = 0, by 
(6.4-3). This contradicts Ax = Ax #0. An eigenvalue cannot be 
repeated infinitely often in the sequence {A,}, because A, — 0. Suppose 
that A, occurs p times. Then the corresponding eigenmanifold contains 
an orthonormal set of p eigenvectors, and is therefore at least p-dimensional. 
It cannot be of dimension greater than p, for this would entail the existence 
of an x such that Ax = àx, [xi] = 1, and (x, x,) = 0 for every n. But 
such a thing is impossible, by an argument given at the beginning of this 
paragraph. The proof of Theorem 6.4-B is now complete. 

The next theorem describes the inverse of A — A. 


Theorem 6.4-C. Let A, {àn}, {x,} be as in Theorem 6.4-B. Then, if 
à z 0 and if à x X, for each k, À — A has a continuous inverse defined on 
all of X and given by x = : — A) iy, where 


(6.4-4) x= NN 5 s 


PROOF. We can discover the foregoing formula as follows. Suppose 
x and y given, such that Ax — Ax = y. Then Ax = Ax — y, and so 
from (6.4-3) we have 


AX — y = 2 Ax, XK) Xie 
We form the inner product with x; and obtain 
(Ax, x;) ias (y, xi) T Aix, x). 
Thus : 


Q x). 
AGAS 


a= y t QUE Xa) 


which gives (6.4-4). This shows that the solution of (A — A)x = y is 
unique, if it exists. On the other hand, if the series in (6.4-4) is 


(x, xi) = 


and so 
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convergent, the element x defined by (6.4-4) certainly satisfies 
(A — A)x = y, for then 


T > (y, XQ x l 1 (y, Xx) 
Ax Ax=yt+ > MY mE Xy — 5 AY — 3 Mode 


We put Ax, = A,x, in the last sum and use (6.4-3) with y in place of x; 
the result is Ax — Ax — y. 

We now show that the series in (6.4-4) does converge, no matter how 
yis chosen. For this purpose let 


Àk | 1 
= su > = sup ————: 
s i Dow ? EP Dess 
Also let 
Q, xx) X) X mM x (y, Xx) 
Un -Fn AA Vn = xw 


Now, if m « n, 


n 
lin = tnl? = > 


k=m+i 


n 


x4)? «e > IG. xW]. 


k=m+1 


Therefore (u,) is a Cauchy sequence, because >|(y, x,)|? is convergent 
(see § 3.2). If X were complete, this would be enough for our purpose. 
If X is not complete we continue the argument as follows: 


M = IG», x)? 2 ; , 2 2152 
||, il - > eee =e <£ 2, lor a0 < B^iyj?, 


so that {v,} is bounded. Now Av, = u,. Hence, the compactness of A 
shows that {u,} contains a convergent subsequence. Being a Cauchy 
sequence, {u,,} must then be convergent to the same limit as the subsequence. 
Hence the series in (6.4-4) converges. We see from (6.4-4) that 


Ix < sr DI + py alb 


Thus we see that (A — A)~! is continuous and defined on all of X, with 


= 


We round out the foregoing discussion by considering the null manifold 
and range of A. The situation is clearest if X is complete. 


Theorem 6.4-D. (a) Let A, {A,} and (x,) be as in Theorem 6.4-B, and 
let M be the closed linear manifold generated by the eigenvectors x1, X2, - * -. 


(6.4-5) IA — APN < si af + sup |z 
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Then MŁ = .W(A). Hence the orthonormal set (x,) is complete if and only 
if Ois notan eigenvalue of A. When X is complete we have X = M ® .W(A). 
(b) Suppose X is complete. Then the range of A is composed of those 
elements y in M which are such that the series 


(6.4-6) ED 
Àk 


is convergent. 


PROOF. (a) It follows from (6.4-3) that M+ c M(A). On the other 
hand, x€ M(A) implies (x, x,) = Aj7!(x, Ax) = A (Ax, x) = 0, so 
that xe Mi. Hence M+ = W(A). The orthonormal set {x,} is 
complete if and only if M+ = (0), which then means that O is not an 
eigenvalue of A. If X is complete, we have X = M CO .K(A), by 
Theorem 4.82-A. For the proof of (b) suppose Ax — y. Then from 
(6.4-3) we see that y is in M. From the orthonormality it follows that 
(y, x) = A(x, xj. We can write x = u + v, ue M, ve (A). Then 
(x, X4) = (u, xy), since v |. M, and so (see Theorem 3.2-H) 


u = D Xx) Xx = » 05 XX i = QR s, 


the series necessarily being convergent if in fact it is infinite. Conversely, 
suppose y € M and that the series (6.4—6) is convergent, with u as its sum. 
Then 

Au = 2», xi)xy = y, 
so that y € Z(A4). This completes the proof. 


We now examine formula (6.4-3) and express it in a somewhat different 
way, for the purpose of showing the relation between the formula and the 
general spectral representation theorem (of 86.5) for self-adjoint 
operators. For the purpose of the following discussion it is assumed that 
X is complete. 

The series (6.4-3) remains convergent, with the same sum, no matter 
how the terms are rearranged in order (see the proof of Theorem 3.2-H). 
It is convenient to rearrange the terms, if necessary, in such a way that 
all the terms for which A, has one particular value are brought so that 
they occur consecutively in the series. We shall now assume that the 
notation has been arranged so that this is true. For each A, let P, be 
the operator defined by 


Pix = > (x, xji)x;. 


Aj=Ay 


Then P; = P, if A; = Ay. It is easy to verify that PjP, = 0 if A; # àp 
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that P,? = P,, and that P, is symmetric. The series (6.4-3) can now 
be written 


(6.4-7) Ax = DA, P,X, 
where the prime mark on the summation sign indicates that the sum is 


extended over the distinct values of A,. In like manner, (6.44) can be 
put in the form 


(6.4-8) a- Arty = yr * $2, LP 


This equation shows that A, is a first-order RN of (A — A)-ly, the 
residue being P,y. It is easy to verify that P, is the projection associated 
with the spectral set (Aj) (as in § 5.8). 

If we use the decomposition X = M @ ./(A) (see Theorem 6.4-D), 
and write x = u + v, u E M, v e (A), we have P,x = P,u and 


u = YP, kX. 
If we define Py by Pox = v, we see that 
(6.4-9) x = Y'P,x + Pox. 


The operator Py is a symmetric projection, and PoP, = P,P) = 0 if 
k #0. 

Now let us define a one-parameter family of operators E, as follows 
(A real, x arbitrary): 


Ex = > P,x ifA«0 
ARSA 
(6.4-10) 
Ex-2x- 2 22 ifA20 
AA 
It is understood that the meaning of a sum is 0 if there exists no points 
A, satisfying the indicated inequality. By separate consideration of the 
cases AX 4&4 «0, A«Oxpu, OxAxp, it is easy to verify that 
E,E, = E,E, = E, if A & p. Hence in particular E? = E, Moreover, 
E, is symmetric. The operator E, is continuous from the right, in the 
sense that 
(6.4-11) lin Ex = E,x, 
A—ut 
where À — ut means that we consider values A > p. This is clear if we 
examine closely the definition of E, The only possible point of 
accumulation of the points A, is at 0. As we move to the right from a 
given point u, E, does not change in value except as A reaches one of 
the points A, or the point 0. Thus (6.4-11) is evident if » # 0, and for 
p = Q it is true as a result of the convergence of the series defining Eo. 
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Since o(A) lies on [m(A4), M(A)], it is easy to see that E, = O if A < m(A) 
and E, = Lif A > M(A). 

We shall denote lim E,x by E, ox. It is easy to see from (6.4-10) that 


As” 


E, — Eo = P if à = àk 


and that 
Ep = Eo-0 = Po. 
Formula (6.4-7) can now be written in the form 
8 
(6.412) p Í à dE,x, 


where [«, 8] is any closed interval such that « < m(A) and M(A) < f. 
The integral here is defined by the usual procedure for a Riemann- 
Stieltjes integral, involving sums of the type 


XulE(u) — Elei) 
with « = ug < py < +--+ <p, — B. (Here we have written E(u;) instead 
of E with subscript u; to simplify printing.) Formula (6.4-8) can also 
be expressed in integral form. First we modify (6.4-8) by use of (6.4-9) 
with y in place of x. In this way we find 


l 
— 1 
A- Ayty = 9 MP + yy Pov. 
Then we have 


(à — Aly = frm dE, y 


The results of this section have, as dde most important application, 
the theory of integral equations with symmetric (or Hermitian) kernels, 
where the spaces and the kernels are such that the corresponding integral 
operators are compact. Compact integral operators were discussed in 
$5.5. For symmetry of the operator, the condition on the kernel is 
k(s, t) = k(t, s). For a classical exposition of the theory of symmetric 
integral equations see Courant and Hilbert, 1, pages 104-118. For an 
historical account, with many references, see Hellinger and Toeplitz, 1, 
part III. 


PROBLEMS 
- If A = Àj for some j, show that the range of A — A consists of all vectors 


Nem to the eigenmanifold corresponding to Àj. For such a vector y the 
general solution of (A — is =y is 


RUM. 
-i»*3 ea x W, 


where w is an arbitrary element of me aa corresponding to A; 
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2. Suppose X is complete. Let (x,) be an orthonormal set, and let (À,) be 
any sequence of real numbers such that A, — 0. Let A be defined by Ax = 


oo 
> A,(x, xy)x,. Then A is self-adjoint and compact. For the compactness, 
k=1 
start with any bounded infinite sequence of vectors. Then the sequence contains 
a weakly convergent subsequence (see Theorem 4.41-B), which we denote by 
{yn}. Suppose |!y,'| < C. Then 
x : 
lAy, — AVi? = > Aln — Ym Xe)? 
k=l 

If e > 0, choose p so that |A;| < eif k > p. Then 

wo oo 
> Aln — Ving x4)l? E: e? ` (On — Ym xp? Es eily, P1 Yml? x 4C?e?, 
k-—ptl k-p-l 
The weak convergence then enables us to show that (.4y,) is convergent, whence 
A is compact. : 

3. Suppose X is a complex inner-product space (not necessarily complete). 
Suppose S and T are compact members of [X] such that ST = TS and 
(Sx, y) = (x, Ty) for all x and y. Then, there exists a finite or infinite ortho- 
normal set (u,) and a corresponding sequence {A,,} such that A, # 0, Su, = A,u,, 
Tu, = Apn, yi? = ZC», u,)|? for each y € Z(S), and A, — 0 if the sequences 
are infinite, Method: Put S + T = 24, S — T = 2iB, and consider A, B. 
They are symmetric and compact, AB = BA, and S = A + iB. 

The foregoing proposition can be used to prove the completeness of the 
orthonormal set {v,}, where v (f) = et and A takes on all real values, in the 
space of continuous almost-periodic functions, with 


h a 
(x,y) = lim Al x(t) y(t) dt. 
h-—x 0 


This is an important example of a non-separable incomplete inner-product space. 
For this application of the abstract proposition Sx — y is taken to mean 


1 h 
ys) = lim | z(s — t)x(t) dt, 
ho 0 
and 7x — y means 
wool S 
y(s) = lim zi 26 - t)x(1) dt, 
ho 0 


where z is a fixed continuous almost-periodic function. In this case the ortho- 
normal set {u,} is a set {v,,)}, where v(m) runs through all the values of A for 
which (z, va) # 0. The A, corresponding to u, is (z, v,,)). For details see 
Rellich, 1, pages 351-355. 


6.41 Symmetric Operators with Compact Resolvent 


As in $ 6.4, we assume that X is an inner-product space, not necessarily 
complete. We also assume that X is not finite dimensional. 
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Theorem 6.41-A. Suppose that T is a symmetric linear operator with 
domain and range in X, and suppose that T~ exists, belongs to [X], and is 
compact. Let (A), {x,} be the sequences of eigenvalues and eigenvectors 
associated with A = T~1, as explained in connection with Theorem 6.4—B, 
and let u, = MA, The sequence {p,} is infinite, and |,| — oo. The 
orthonormal set (x,) is complete, and 


ll 
Ms 


(6.41-1) (x, Xi) Xx 


for each x € Z£(T). A point y is in o(T) if and only if it is one of the ugs. 
We have Tx, = u,x,. If wis not in o(T), 


V (P, xa) 
.41-2 E -ly = LAM LN d 
(6.412) (u — Ty) ly Prem k 


for each y €X. This inverse operator is compact. 


PROOF. The symmetry of T implies that of A; hence we can apply the 
results of $6.4. We observe that Ax, = A,X, is equivalent to x, = A,Tx,, 
or Tx, = UX The orthonormal set {x,} is complete, by Theorem 
6.4-Da, because 0 is not an eigenvalue of A (since A~! exists) The 
orthonormal set must therefore be infinite, since X is infinite dimensional. 
Hence |u,| — œ, for we know that 4, > 0. The range of A is the domain 
of T; since each x € Z(T) is of the form x = Ay, (6.41-1) is a consequence 
of (6.4-3). Next we show that 


(6.41-3) (~T) = ytd = =) 


if u is different from 0 and all of the u,'s. First suppose that x e Z(T) 
and (u — T)x = y. Then udx — x = Ay, (A — u^ )x = wo lAy, and 
X = u71(4 — n7!)-14y. On the other hand, if y € X and x = p14 
(A — ut) ty, then x €Z(T) and it is easily verified that (u — T)x = 
(A — WINA — p-1)-1y = y. Since A permutes with (4 — p!) !, this 
proves (6.41-3). The compactness of (p — T) follows from this 
formula (see problem 4, § 5.5). To obtain the formula (6.41-2) we use 
(6.4-4). First we have 


Then 


-1 2 , x, 
sala- =) ye -Ay t p> ew x 
k=l 
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If we express Ay by (6.4-3) and simplify, we obtain (6.41—2) from this 
result and (6.41-3), This finishes the proof. 

We observe that the operator T of Theorem 6.41-A is not continuous, 
because ||x,|| = 1 and l[Tx,|| = llu,x,]j = |u,| — oo. However, T is closed, 
because T = A~! and 4 is closed. 

Theorem 6.41-A can be applied to certain kinds of differential equation 
problems. For instance, consider the type of second-order differential 
operator discussed in Example 2, $6.11, with boundary conditions such 
that the operator is symmetric. We shall now denote the operator by T 
instead of A. Then Tx =u means that x¢ Z(T) (which includes 
specification of the boundary conditions) and 


- S POKO] + Ox) = «0. 


Also, (u — T)x = y means x € Z(T) and 
(641-3) [px Ol + lu — op) = »0. 


In order to be able to apply Theorem 6.41—A to this operator T, we have 
to show that T~! exists and is a compact operator defined on all of X. 
This can be shown to be true in certain cases by construction of a Green's 
function k(s, P). The service provided by the Green's function is that of 
being the kernel for an integral operator which turns out to be T-t. If 
one can show that the Green's function exists and that the corresponding 
integral operator is compact, then Theorem 6.41-A is applicable. The 
Green's function is Hermitian (i.e., A(t, s) = k(s, t)) as a consequence of 
the symmetry of the operator 7. 

There is not space in this book for a detailed treatment of boundary- 
value problems for second-order ordinary differential equations. For an 
extensive discussion, using the full power of spectral-theory methods in 
Hilbert space, see Stone, 1, pages 448-530. Another useful discussion of - 
differential operators from the Hilbert space viewpoint is to be found in 
Achieser and Glasmann, 1, pages 304-356. For an extensive discussion 
of eigenfunction expansions associated with the equation (6.41—3) [for 
the special case in which p(t) = 1] see Titchmarsh, 2. Titchmarsh does 
not employ abstract operator-theory methods; however, his use of 
contour integrals and the calculus of residues is closely related to the 
fact that (A — 7)~! is an analytic function of A on the resolvent set of T. 

It is not always true that T has a compact resolvent. When it does 
not, there may be continuous spectrum in addition to or in place of point 
spectrum, and then the series expansions (6.41--1); (6.41—2) are replaced 
by integral representations. 
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PROBLEM 


Suppose that H is a continuous symmetric operator such that H^! exists and 
belongs to [X]. Let Tand A = T-! be as in Theorem 6.41-A. Let B = HAH 
(a compact and symmetric operator), and let (4,) be the nonzero eigenvalues 
and {x,} the corresponding eigenvectors associated with B, just as in 8 6.4. 
Show that (u,H? — T)(H-!x,) = 0, where p, = 1/À,. The orthonormal set 

[4] 


íx,) is complete, and x = > (x, Hx,MH 1x, foreach x e Z(T). If u is different 
1 
from every i, uH? — T has a bounded inverse defined on all of X and given by 


Q, Ho xn) gy 

H? — Ty 
(u yy = > ee eae 
To show this, show first that 

-1 -1 
(uH? = T) = ; u-(s = 2) HA =  AH(B = :) H- 
m Hu n m 
if u # 0. 

This problem has an application to the boundary-value problem corresponding 
to the equation (6.41-3) with p(t) in place of p, where p(t) is a positive real 
function such that, if H maps x(r) into V/p(D)x(D, then H and H-! are bounded 
operators on X. 


6.5 The Spectral Theorem for Bounded Self-adjoint Operators 


In this section we consider an arbitrary bounded self-adjoint operator 
A on a complex Hilbert space X. These assumptions about A and X 
apply to all the theorems of this section. Our aim is to obtain generaliza- 
tions of the formula (6.4-12) and to use the results to establish a useful 
operational calculus. The methods are quite different from those used 
in § 6.4, for now we do not assume that 4 is compact, and the spectrum 
can be much more complicated. 

Before stating the first theorem we call the reader's attention to the 
definitions of m(A) and M(A) in (6.11-2). Since A is continuous, m(A) 
and M(A) are finite. 


Theorem 6.5-A. There exists a family of orthogonal projections E, 
defined for each real à, with the properties 


a EE,-E,E,—E,fA&pL 
b. lim E,x = Ex. 
poat 
c. E, =O A < mA}, E, = Lif M(A) <A 
d. E,A = AE). 
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For each x and y in X, (Ex, y) is of bounded variation as a function of À, 
and 


(6.5-1) (p(A)x, y) = MC d(E,x, y) 


for each polynomial p(X) with real coefficients. The integral is an ordinary 
Stieltjes integral over any interval [«, B] such that « < m(A), M(A) < B. 


PROOF. Let p(A) be any polynomial with real coefficients. Then p(A) 
is self-adjoint, and therefore the spectral radius of p(A) is ||p(A)|| (Theorem 
6.2-C). Now o[p(A)] is the set of values of p(3) for A € o(4) (Theorem 
5.2-D); consequently 


(6.5-2) ip(a) = sup |p). 
àco( A) 


Now let C be the real Banach space of real-valued continuous functions f 
defined on the closed interval m(A) < A € M(A), with ||f|| defined as the 
maximum of |/(A)| on the interval. If we consider the polynomial p as 
a member of C, we evidently have j\p(A)j| < |pll, by (6.5-2) and Theorem 
6.2-B. We can consider the class P of polynomials p with real coefficients 
asasubspaceof C. Sinceany member of Ccan beapproximated uniformly 
as closely as we please by a member of P (the Weierstrass theorem), the 
subspace P is dense in C. 
Now consider any two vectors x, y, and let 


L(p) = (p(A)x, y). 


It is readily evident that L is a complex-valued linear functional defined 
on P and that 

(6.5-3) IL(p)| < lpi ‘xli iyl- 

Thus L is continuous on P and may be extended in a unique way by 
continuity to give a continuous linear functional defined on C. We denote 
the extension by L also. We now refer to § 4.32 for the representation of 
continuous linear functionals on the space C. We write L(f) = L(f )-- 
iL,(f), where Lı and L, have real values. On applying Theorem 4.32-B 
to L, and L, and then combining results, we see that there exists a complex- 
valued function of bounded variation V(A; x, y), depending on x and y 
as parameters, such that 


M(A) 
(6.5-4) (4.3) = f PO aVOsx, y) 


for each p in P. In order to have V(A; x, y) uniquely determined by the 
functional L, we agree to have V(A;x, y) normalized in the manner 
explained in § 4.32, i.e., V[m(4); x, y] = Oand VA; x, y) = V(A + 0;x, y) 
if m(A) < A < M(A). 
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In several parts of subsequent arguments we shall need the following 
uniqueness principle: If v is a function of bounded variation on [a, b], 


b 
normalized as in $4.32, and ir f t” de(t) = 0 for n = Q, 1, 2, ---, it 


b 
follows that f x(t) dut) = 0 for every continuous function. This 


depends on the Weierstrass theorem about approximating continuous 
functions uniformly by polynomials. Then v ~ 0 and hence e(z) = 0 
(see § 4.32). 

The next step is to show that for each A, V(A; x, y) is a continuous 
symmetric bilinear form in x and y, in the sense of $6.1. If œ is any 
scalar and n = 0, 1, 2,---, we have 


f Y dV(A; ax, y) = (Antex, y) = a(A"x, y) = « Í Y dV(; x, y) 


= f à" d[«V(A; x, y)]. 


We omit the limits on the integral signs, for convenience. The uniqueness 
principle mentioned above now shows that V(A; «x, y) = «V(A; x, y). 
Similar arguments show that V(A; xj + xa, y) = VO; xi, y) + VO; 
Xz, y) and V(A; y, x) = V(A; x, y) For this last relation we use the fact 
that A" is symmetric. The inequality (6.5-3) enables us to assert that the 
total variation of V(A; x, y) does not exceed 2/x; ||), for the real and 
imaginary parts of V have variations equal to /£,; and |L‘ respectively. 
Hence |V(A; x, y)| < 2ixj yi; this shows that the bilinear form is 
continuous. By Theorem 6.1-B we now see that for each A on [m(A), 
M(A)] there exists a bounded linear operator F(A) such that V(A; x, y) = 
(F(A)x, y). Since the bilinear form is symmetric, so is F(A). The fact 
that V[m(A); x, y] = 0 implies that F[m(A)] = 0. If we put p(4) = 1 in 
(6.5-4), we see that V[M(A); x, y] = (x, y»). Hence F[M(A)].— 7. Next 
we prove that 


(6.5-5) FO)F(w) = F(g)FQ) = FQ) — ifA «€ p. 


In particular, [F(A)]? = FQ), so that F(A) is a symmetric (and orthogonal) 
projection. The proof involves use of the following easily proved 
theorem about Stieltjes integrals: Suppose f and g are continuous and v is 
of bounded variation on [a, b]. Let 


TOES p: g(s) do(s). 
Then 
b b 
[70 a«o = f AOO 4. 
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We also need to know that, if v is normalized, so is u. Now let 
UA; x,y) = [um dvs x,y), 
where we have set a = m(A), b = M(A). Then 
f ” ye UCAS x, 9) = f ymin dV; x, y) = (A™*nx, y) 
= nx, Amy) = Ji " Y AVOA; x, A”). 


By the uniqueness principle we have 
U(A; x, y) = WA; x, Amy). 
Now 
b 
VA; x, Amy) = (FQ)x, Amy) = (AMF), y) = i um dV [ws FQ)x, y]. 


Consequently 
fun atiis. ») = [om EFO, 9). 


The integral on the left can be written as 


b 
h u” dW(u; x, y), 
where 


f | f(FQ)») ifa<su<sà 
"Ope ene »k- He eet: 


Thus, using the uniqueness principle again, we find that (F(u)F(A)x, y) = 
(F(v)x, y), where v = min (A, x). This implies the result (6.5-5). 
Lastly, as regards F(A), we assert that F(u)x > F(A)x as p> At if 
a«àÀ«b. Wewrite F(A + 0)x = lim F(pu)x, by definition, so that our 
' pat 


assertion is 
(6.5-6) F(A + 0)x = F(A)x, a<A<b. 


To prove this we observe by (6.5-5) and Theorem 6.3-C that F(u) — F(A) 
is a symmetric projection if A < u. Therefore 


lF(g)x — F(A)x|? = (GFG)x — FO)x, x) = G'(pyo x) — (FAx, x). 


This expression approaches 0 as p.— A* if a < à< b, because V(A; x, y) 
is normalized. Thus (6.5-6) is proved. Likewise, if a < A; < àz, 


[FAx — FAx = (FAx, x) — (FAx, x) > 0 
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as A, and A, — at, because (F(A)x, x) = V(A; x, x) > Via + 0; x, x) as 


À— a*. Therefore lim F(A)x exists and defines an operator F(a + 0). 


Ansa 


We now know that 
(6.5-7) (p(A)x, y) = f : P(A) a(FQ)x, y). 


We define E, — 0 if A<a, E, — I if b € A, and E, = F(A + 0) if 
a<A<b. This makes E, = F(A) if a < à< b. It is easy to verify 
that conditions a, b, and c in Theorem 6.5-A are fulfilled. Since E, may 
differ from F(A) at à = a, we cannot replace F(A) by E, in (6.5-7). But, 
if « < a and b < £, simple calculations show that 


B 
f pla) d(E,x, y) = 0 
and that 


a b 
f oN dex,» + [ 00) atx, ») - (Oy, 9) = 0. 
Thus we obtain (6.5~1). 
The fact that AE, = E,,A is easily deduced from (6.5-1). We have 


B 
(E, Ax, y) = (Ax, E.) = f M(Eyx, E, y), 


8 
(AE,x, y) = I à d(E,E, x, y) = (E,Ax, y), 


because (E,E,x, y) = (E,E,x, y) = (Exx, E,y. Thus £,A = AE,. 
Theorem 6.5-A is now proved. ® 

We observe that (E,x, x) is a nondecreasing function of À. This is 
equivalent to E, < E, if à < p, which is equivalent to the known relation 
E,E, — E, by Theorem 6.3-C. Just as in a previous argument about 
F(A), we can also conclude that lim E,x exists and defines an operator 

A> 

E,.9, which is evidently a symmetric projection. 

The next theorem shows that (6.5-1) is matched by a direct formula for 
p(A), without intervention of x and y. 


Theorem 6.5-B. 77e formula 
B 
(6.5-8) P(A) = | pQ) dE, 
holds, the integral on the right being defined in the usual way as a limit of 


Riemann-Stieltjes sums, with convergence in the norm topology of the 
operator space [X]. 
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PROOF. We recall that « < m(A), M(A) < B. Suppose that « = Ay < 
Ay <--> <A, =f and that àp- < nu S àp k = 1,2,:- n. Let 


B= > pau) — EQ] 
k=l 


Let e, = max [p(4) — p(&)| as A and u vary over [àx-1; A], and let 
€ = max (€j, © °, e). Now 


((4)x, = > [^ pO) dE sx, 9) 
k=1 "k-11 


Bx x) = D D pli) dE, 3. 
k=1 *^%k-1 


Since (Ex, x) is nondecreasing, we see that 


(p(A)x, x) - (Bx, x) < > M ed(E,x, x) = «(x, x), 
k=l “k= 


and hence that M[p(A) — B] € « [see (6.11-2)]. In a similar way we see 
that — e < m[p(A) — B]. But then ||p(A) — Bi < e, by (6.11-3. Now 
« — 0 as we carry out the usual limiting process in connection with a 
Stieltjes integral, because of the continuity of p. We see in this way that 
(6.5-8) is true in the sense asserted. g 

The family of projections E, having the properties specified in Theorem 
6.5-A is unique. This follows as a result of the uniqueness principle 
for normalized functions of bounded variation which was mentioned in 
the course of the proof of Theorem 6.5-A. It can even be shown, though 
we do not give the details, that, if G, is a family of symmetric projections 
satisfying conditions a, b, and c of Theorem 6.5-A and if the equation 


B 
(4x, x) = Í à d(G,x, x) 


holds for every x, then G, = E, for every À. Because of this uniqueness, the 
operator A fully determines the family E, (and is, of course, fully deter- 
mined by the family). This family of projections is called the resolution 
of the identity corresponding to A. 

Next we consider the integral 


B 
(6.5-9) | fA) dEy 


where f is an arbitrary complex-valued continuous function defined on 
the interval m(A) < A < M(A). We extend the definition of f by setting 
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SOA) = UNA) if « < A < m(A) and fA) = fLM(A)] if MA) <à x f. 
In order to show that the Stieltjes integral (6.5-9) exists (as a limit of 
sums in the topology of [X]), we can proceed as follows: First suppose 
that f has real values. Referring back to the proof of Theorem 6.5-A, 
we can now see that 


Lfixy) =f P FO) dE, 9). 


and that this is a continuous symmetric bilinear form in x and y. Hence 
there exists a uniquely determined self-adjoint operator, which we denote 
by f(A), such that 


(f(A)x, ) = fo Ex, 9). 


It is now easy, just as in the proof of Theorem 6.5-B, to show that 


B 
(6.5-10) f(A) = | fd) dE, 


If fis complex valued, the integral in (6.5-10) exists, as we see by separating 
f into its real and imaginary parts. In this case also we denote the 
value of the integral by f(A). 


Theorem 6.5-C. The correspondence between the continuous function 
f and the operator f(A) indicated in formula (6.5-10) has the properties: 


a. (f + XA) = f(A) + g(A). 
b. (af (A) = «f(A). 
EXA) = fCA)gCA). 
. f(4)B = Bf(A) if Be [X] and BE, = E,B for every A. 

e. f(A) is normal, with f(A)* corresponding to the function with values 
JO). 

f. f(A) is self-adjoint if f is real-valued, and f(A) 2 0 if f(A) > 0 for 
every À. 

g. ICAJ] < max | f()| {A varying over [mCA), M(A)]}. 


A. Ge = [LroyediExi. 


& n 


PROOF. Properties a and b are obvious. To prove (c) we use an 
approximating sum for f(A): 


> fA) EQ) — EQ) 


k=1 
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and the exactly corresponding sum for g(4). On multiplying the sums, 
the fact that 


E(M)— EQ.)  ifj=k 
[EOD = EOD EQ) = 0-9] = {0 es 
yields us the sums 

PAANAN) IEA) — EQ&1)]. 

The limit of this sum is evidently (fg)(A); but it is also f(A)g(A). Thus 
(c)is proved. Property d may also be proved by using the approximating 
sums. We leave (e) and (f) to the reader. For (g)let||/|| = max | /()|, 
and suppose « = Ay < Ay <+- <A, — B. Then 


x = [EQ - EQg)x = > EAD — EO), 
k=l 


and by the orthogonality relations among the projections E(A,) — E(A,. 1), 
we find that 


(6.5-11) lxi? = > EO.) — EQx-1))*|/?. 
k=1 
Also, 


IG)? = lim (Zooo = Edk, > SAMEA) — 2 
k j 


= lim > fA? HEA) — EQ)? 
k 


< II Ixl, 

by (6.5-11). This proves (g) and at the same time proves (A), for 
IEA) — EAr- = (EA) — EQ—))o x) = EA — LEA, 1) 1: 
We can also obtain A from c and e. This completes the proof. 

Theorem 6.5-C exhibits a homomorphism of the algebra of continuous 
functions on [m(A), M(A)] into the algebra [X]. As in the case of the 
homomorphism referred to in Theorem 5.6-A, the present homomorphism 
furnishes what may be called an operational calculus. 


Next we shall see that the behaviour of E, as a function of À is closely 
correlated with o(A). 


Theorem 6.5-D. Jf A, is real, then Xo € p(A) if and only if there is 
Some e > 0 such that E, is constant when àg — e S À S An + e. 


PROOF. We prove the “if” part first. Let f(A) = Ao — A, and define 
(A) = (Ag — X)! except when Ay — e € A € Ay + e; the values of g on 
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this latter interval can be assigned arbitrarily, except for the requirement 
that g be continuous. Then /(A)g(A) = 1 except on the interval 
[Ao — € Ag + e]. Since E, is constant on this interval, it follows that 


B 
f(A)g(A) = NICO dE, = f dE, = I. 


Therefore g(A) is the inverse of Ay — A — f(A4). This implies that 
ào € p( A). 

For the “only if? part we can assume m(A) < Ay < M(A), because of 
Theorem 6.2-B and the known facts about E, for A < m(A) and 
M(A) « 4. Suppose, no matter how small e is, that there are points A, 
and A, in the interval [Ay — e, Ag + e] suchthat à; < A, and E(A\) # E(A). 
Since E(A,)E(A;) = E(A), the range M, of E(A,) is properly contained in 
the range M; of E(4;), and we can choose an element y in M; — M; and 
orthogonal to M,. Then E(A;)y = y and E(A)y = 0. If A < Aj, then 
E,y = EE(M)y 20; if à, <A, then Ey = E,EQ3)y = EQ3)y = y. 
Thus, since E,y is constant if A < A, and also if à, < A, part h of 
Theorem 6.5-C shows that 


» 
lo — Ayl? = ii (à — A? dE? < ellyl2. 


The last inequality follows from the fact that (Ey, y) = |E,yI? is 
nondecreasing and never exceeds ||yjj2. We now see that 


inf |(Ag — 4)xl| = 9, 
fixi! 


which implies that Ag €o(A). This completes the proof of Theorem 
6.5-D. 

We see readily, somewhat as in the first part of the proof of Theorem 
6.5-D, that the resolvent of A is given by 


pu 
-— EE SE  — 
(6.5-12) Qs — Ay = J; x3 dE 


if Ag is not on the interval [m(4), M(A)]. If Ao is a point of p(A) on the 
aforementioned interval, (6.5-12) is still valid; the singularity of 
(Ao — 2)-1 at Ag causes no trouble because of the fact that E, is constant 
on a neighborhood of Ap. 


Theorem 6.5-E. The point spectrum Po(A) consists of those points u 
for which E, # E, s. The corresponding eigenmanifold is then the range 
of the projection E, — E-o. The continuous spectrum Co(A) consists of 
those points u for which E, = E, but which are such that E, is not constant 
in any neighborhood of y. 
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PROOF. (For the definition of E, 9 see the remarks following the proof 
of Theorem 6.5-A.) From the fact that E,E, = E, if A < u we easily 
deduce that E,E, 9 = E, 9 if p < A and E,E, 9 = E, if à < p. Hence 
also E, ; and E, — E, 9 are projections (see Theorem 6.3-C). Suppose 
E, Z E, Lety = (E, — E,.o)x, with y # 0. The foregoing relations 
show that E,y = Oif A < wand E,y = yifp < A. Then, using Theorem 
6.5- Ch, we have 


B u 
Ke - Ayi? = [e -dE = e - x aie = 0. 


The vanishing of the last integral depends on the fact that (u — A)? = 0 
at A = p. We see that p is an eigenvalue of A. 
Suppose, conversely, that u € Po(A), y # 0, Ay = uy. Then 


B 
0 = [& - 3 d£. 


We may suppose M(A) < f, since the integral is independent of £ as long 
as M(A) < B. Now « < m(A) < u < B, so we may choose « > 0 so 
that « < p — cand u + e < B. We use the facts that (u — A)? > 0 and 
E y|? = (Ey, y) is nondecreasing to conclude that 


u—e 
[€ = eazy = o. 
This integral, however, is not smaller than 


(IE, ll? — Eyl?) = «2E, yl?. 
Therefore E,.,y = 0, whence E, 9y = 0. We also conclude that 


B. 
f? œ- Xe aleve = 0, 
ute 
and from this that 


0 = eXiEsyll? — E yll) = eXliyl? — Ere yl), 
whence E,,,y = y and finally that E,y = y. Therefore E, # E, y. 
Also, y = (E, — £, o)y, so that the assertion of the theorem is proved 
as far as Po(A) is concerned. The part about Co(A) follows with the aid 
of Theorem 6.5-D. 

The actual determination of the resolution of the identity for a given 
operator A is not an easy matter, in general. In some comparatively 
simple cases it may be inferred or conjectured from (6.5-1) or 6.5-4). 
This is so with problems 5 and 6 at the end of this section. A methodical 
procedure is furnished by the following formula. Suppose « « m(A) 
ande > 0. Then 


(55-13) — MOL 9) GE, 9] = lim zi f, (= 97x 0 A, 
630 £71 Jr 
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where I’ is the polygonal line joining p + ie, « + ie, « — ie, and u — ie 
in that order. See Dunford, 3, page 58. The proof of (6.5-13) depends 
on the use of (6.5-12). 


PROBLEMS 


l. Let X be a complete inner-product space, with either real or complex 
scalars. Let (4,) be a sequence of self-adjoint operators such that A, < Ani, 
and (A,x, x) < exi? for each n, where « is a real constant. Then there exists a 
self-adjoint operator A such that A„x — Ax for each x. A similar proposition 
is valid if all the inequalities are reversed. For the proof, first show that the 
sequence {||4,|/} is bounded. Then apply (6.11-7) to H = A, — Am, where 
n > m, treating H like A — A in the proof of Theorem 6.2-B. The result is 


[A,x — Agxii* < [Guo X) — (Amx, xX)lkilxli?, 


where k is a constant. The rest of the argument is left to the reader. 

2. Let X be asin problem 1. Let {4,,} be a sequence of self-adjoint operators 
such that 4, < 4,,, for each n, and let A be an operator such that (4,x, x) > 
(Ax, x) for each x. Then A,x — Ax. Instead of A, < A4,,, we may have 
Á,41 S Án, and the conclusion is the same. For the proof the first step is to 
prove that lim (4,x, y) exists for each x and y. Next, show that (74, is 


H—90 
bounded. Then problem 1 is applicable to obtain 4,x — Bx for some B and 
each x. Finally, A = B. 

3. Let X, A and E, be as in Theorem 6.5-A. Then for each A there exists a 
sequence p, of polynomials such that p,(A)x — E,x for each x. This is readily 
evident for À < m(4) or M(A) < A. Suppose « < m(A) < p < M(A) x B, 
O«h«f -—p, and define f(A) = 1, 1 — (A — p), or O according as 
a<A<pypsAcpt+horpt+h<A<f. Then using (65-10) we find 


uih 
UG, X) = (Ex, 3) + | FO 4(Eyx, 3). 


It follows from this and problem 2 that f(A)x > E,x as h — 0. If h = 1/n, let 
the correspondingfbef,. Choosea polynomial p, such that |p,(A) — f,(A)| < L/n 
if c « A « B. With the aid of Theorem 6.5-Cg it can then be shown that 
P,(A)x > E,x. 
4. Show from problem 3 that, if B e [X] and AB = BA, then BE, = E,B. 
5. With X = /2, let Ax = y be defined by 7; = «,€;, where o; is real and 
sup |æ;| < œ. Then o(A) is the closure of the set of the «;’s, and the @;’s form 
i 


Po(A). The resolution of the identity corresponding to A is defined by 

(Exx, y) = > £m. This means that the matrix representing E, is a diagonal 
aià 

matrix with 1 in the ith diagonal position if o; < A, and O there otherwise. 

6. Consider X = La, b), where (a, b) is a finite interval. Let Ax = y be 
defined by y(/) = tx(r). Then o(A) is the closed interval [a, b], and Po(A) is 
empty. The resolution of the identity corresponding to A is defined by 
Ex = u, where (fora <A < b), uN = x(D ifa < t < A,u(D = Oif A « t « b. 
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7. Consider X = L?(— oo, 00), and suppose a(r} e .£!(— oo, oo). Suppose 
also that a(r) is real and that a(— 7) =° a(t). Define Ax = y by : 


x = | ji ais dati dt. 


oo 
Then A is self-adjoint and |A|] < f |a(?)| dt. Let 


B(s) = f 7 aist a(t) dt. 


Then o(A) is the closure of the range of b, and A € Po(A) if and only if b(s) = A 
on a set of positive measure. The resolvent of A can be expressed in terms of 
Fourier transforms and then the resolution of the identity can be computed 
from (6.5-13). See Dunford, 3, pages 60-64, and Pollard, I. 


6.6 Unitary Operators 
Let X be a complete complex inner-product space. 
Definition. An operator U € [X]is called unitary if UU* = U*U = I. 


Note that a unitary operator is normal and that U* = U-1. We have 
(Ux, Uy) = (x, U*Uy) = (x, y) for every x and y. It follows that U 
maps X isometrically onto all of X. 


Theorem 6.6-A. Jf U is unitary, o(U) lies on the circle |A| = 1. 


PROOF. Since U and U* are isometric, we see that ||U]| = ||U*|| = 1. 
Hence AE p(U)M p(U*) if |A| > 1. We know O€p(U), because 
U-1 = U*, Suppose 0 < || < I. Then Ae p(U*). NowA— U= 
AU(U* — 2-1), and it follows that (A — U)! = A-I(U* — A-!)-1U*, so 
that à € p(U), This completes the proof. 


Example |. With X = L?{a,b) and « real let Ux — y mean 
y(t) = eiex(f). Then U is unitary. The set o(U) consists of the closure 
of the set of values of ei”, a < t < b. The interval may be infinite. 

There is a spectral theorem for unitary operators, corresponding 
closely to Theorem 6.5-A. In order to state the theorem we consider 
trigonometric polynomials, i.e., functions of the form 
(6.6-1) pleit) = c, eikt, 

ES i 
with the complex coefficients c,, and arbitrary n(n = 0, 1, 2, -- -). We 
define 
(6.6-2) pU) = > Ut, 


——n 
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where U* = (U-1)-* ifk < 0. Then 


n 


KU) > 40+. 


k=—n 
It is clear that p(U) is normal. 


Theorem 6.6-B. Corresponding to the unitary operator U there is a 
family of symmetric projections E, such that 


a. EE, = EE, = E ifs <t. 


b. Eno = E,. 
c. E =0ift <0, E, =Jif2a <t. 
d. E,U = UE, 


For each x and y, (E,x, y) is of bounded variation in t, and (E,x, x) is a 
nondecreasing function of t. For each trigonometric polynomial p(ei?) 


(6.6-3) (p(U)x, y) = ie pee") a(E,x, y). 


PROOF. Let P[0, 27] be that subspace of the complex Banach space 
C[0, 27] which is obtained by selecting out those functions f such that 
fO) = fQ7). We need to know how to represent the normed conjugate 
of P[0, 27] as a subspace of the space BV[0, 27]. By Theorems 4.3-A 
and 4.32-B, each continuous linear functional on P[0, 27] is representable 
in the form 


(6.6-4) LP) = [^ IO ao, 


where the total variation of vis||L|. Let us define an equivalence relation 
in BV[0, 27], w, ~ w, meaning that 


Ir Qn 
f ft) dw) = | fH wÀ 
0 0 


for each fe P[0, 27]. It turns out that w ~ 0 means w(0) = w(27) and 
w(t + 0) = w(t — 0) = w(0 + 0) = w(2z — 0) if 0 < t < 27. We shall 
now say that w is normalized (relative to P[0, 27]) if w(0) = 0 and 
w(t + 0) = w(t) when 0 € t < 27. Then, much as in § 4.32, it can be 
shown that the normed conjugate of P[0, 27] is congruent to the subspace 
of normalized members of P[0, 27], under the correspondence L «> v 
exhibited in (6.6—4). 

If p(e*) is a trigonometric polynomial, it is an element of P[0, 27], and 
as such has a norm ||pl|  max|p(e?)|. We wish to show that 
llp(U) < |p|. For this purpose we define a function F by F(A) = p(A) 
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if 0 < |A| < 2, F(A) = 0 if 3 < |AJ. We can then compute F(U) by the 
operational calculus based on formula (5.6-10), for F&e9(4(U), by 
Theorem 6.6-A. It is necessary to integrate over two circles, say 
|A| = !/; and |A| = 3/5. For |A| > 1 we have 


bent y 


Anl? 


for |A| < 1 we use A — U = (AU-! — 1)U and find 
(à— U)! = —U-i » wu 
> 


It is then easily verified that F(U) coincides with p(U) as defined in 
(6.6-2). It then follows from Theorem 5.71—-A that o[p(U)] is the set of 
values assumed by p(A) for Aeo(U). The spectral radius of p(U) is 
lp(U)|, by Theorem 6.2-E. It then follows that ||p(U)|| < lIpll. 

The proof now proceeds much as in the case of a self-adjoint operator. 
Since 


(Wx, »)| < lepli lxi lyi 


(p(U)x, y) is a continuous linear functional on the trigonometric poly- 
nomials, viewed as a subspace of P[0, 27]. Since this subspace is dense 
in P[0, 27], (p(U)x, y) determines uniquely a continuous linear functional 
L(f; x, y) on P[0, 27]. Let V(t; x, y) be the normalized function of 
bounded variation corresponding to this functional. Then 


(6.6-5) (p(U)x, y) = {ote dV(t; x,y). 


The normalization ensures V(0; x, y) = 0, and V(27; x, y) = (x, y) 
follows by putting p(A) = 1. We leave to the reader the proof that 
V(t; x, y) is a continuous bilinear form. Then there exists a family of 
symmetric operators E,, defined when 0 < ¢ < 2r, such that V(t; x, y) = 
(E,x, y). Evidently Ey = 0 and Ej, = I. We define E, 20 if t < 0 
and E, = Jif 2» < t. The rest of the proof is similar to the argument in 
§ 6.5, and we leave it to the reader. 
Next comes the counterpart of Theorem 6.5-B. 


Theorem 6.6-C. The formula 
2a 
(6.6-6) p(U) = i p(ei) dE, 


holds, the integral being defined as a limit in the norm topology of the space 
[X]. 
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PROOF. It will suffice to prove (6.6-6) for the special case p(eir) = eint; 
the general case will then follow by linearity. Form a subdivision 
0 = fo «t4 <---+ «€ t, = 2r and choose arbitrary points s, such that 
fk 1 S Sk S fy. Let 


B- > em (E(t) — E(t, 
k=1 


and write 4 = Ur — B. Now (U"x, U*x) = (x, x). The operator 
P, = E(t) — E(t,.,) is a projection, and P;P, = 0 if j z k. From this 
we see that 


m 
BB* = B*B = > |ei"s|2 P, emu. 


k=l 


so that B is unitary. Therefore 


(6.6-7) |Ax|2 = 2(x, x) — (Bx, U"x) — (U"x, Bx). 
Next, 
(6.6-8) (E,x, Unx) = fe -int d(E,x, x). 


This is because 
2a 
(Exx, Urn) = (UME, x) = | em (EEx, x), 


and we can use (a) of Theorem 6.6-B. We can now write 
(Bx, Unx) = > eins E(t,)x — E(ty1)x, Unx) 
k=l 


= -> eins, ae d(E,x, U"x) 


" > I: ets d(Ex, x). 
tk 


We used (6.6-8) at the last step. We now have 
(Ux, Bx) + (Bx, Ux) = 2 T cos n(s, — t) d(E,x, x). 
fk-1 
Therefore from (6.6-7) we: see that 


Axl? = ^ p [1 — cos n(s, — 0] d(E;x, 3). 
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If e > 0, we can make all the intervals (t,_j, t) so short that 1 — 
cos n(s, — D) < e2if t , <t<t, Then 


lxi < «X [^ n x) et 
kc] © 'k-1 


This completes the proof. 

There are developments parallel to the later part of §6.5. To each 
f €P(0, 2] there corresponds a uniquely determined operator Uy such 
that 


(Up) = [7 f Bx. 


27 
lU? = f fl? 4(E,x, x), 
and 


Uns B f(t) dE,. 


We write U, rather than /(U), because in a formal sense Up results from 
putting U in place of ei, not in place of ¢ [e.g, Up= 1 — U^? if 
f(t) = 1 — ei]. We have ||U;|| € f|, and the mapping f-> Uy; has 
the properties corresponding to (a)-(d) of Theorem 6.5-C. In particular, 
if |A| 4 1, 


MSS 2n 1 
(6.6-9) A- Uyi- ih nh. 


A point eis is in o(U) if and only if s is not interior to an interval of 
constancy of E,; if 0 < 4 < 2m, eit € Po(U) if and only if FE,» A Ep We 
omit the details. 

The family E, is called the resolution of the identity for U. 


Example 2. The Fourier-Plancherel transform defines a unitary 
operator Fin L2(— oo, oo). The definition of F is Fx = y, where 


1 d f° ecit—l 
lc fo 
y(t) apt =a x(s) ds. 


An alternative formula is 


t = 9 Lim. = f e7stx(s) ds, 
Xo) Qq— 00 V 2n -t (s) 

where Li.m. means "limit in mean," ie. the limit in the metric of 
L?(— œ, oo). Itturns out that F4 = J, and with the aid of this it is rather 
easy to show that o(F) consists of the four eigenvalues +1, ti. The 
resolution of the identity for F is E, — 0 if t< 7/2, E, — P, if 
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v[2Xt«m, E, = Pi +P, if m < t< 37/2, E, =P, + P; +P, if 
37/2 < t < 2r, and E, = Jif 2m < t, where 


P, =40-iF — F? + iF’),  P,-iü—-F-c-F?-F) 
P; = YU + iF — F2 — iF?) 
See Riesz and Nagy, 1, pages 291-292. 


PROBLEMS 


1. If A e [X] and ||4xl| = |ixl| for every x, then A is called isometric. Show 
that A*A = I in this case. An isometric operator is not necessarily unitary. 
Consider X = /? and A(£,, £», «+ +) = (0, £i £s +° °). 


2. If A is isometric but not unitary, then #(A) is a proper closed subspace of 
X. If X is finite dimensional, every isometric operator is unitary. 


3. Discuss o(U) and (A = Uy! if U(£, Ez, S ) = (£2, i, £4, £s, mes ‘), with 
X=., 


6.7 Unbounded Self-adjoint Operators 


In this section we shall discuss briefly the adjoints of unbounded opera- 
tors and certain facts about unbounded symmetric operators, especially 
unbounded self-adjoint operators. The purpose of the section is to orient 
the student who desires to study these matters further elsewhere. There 
is not space in this book for an extensive treatment of these topics. The 
subject matter leads on naturally into applications to symmetric differ- 
ential operators, and there are important applications to quantum 
mechanics. ` 

We assume that X is a complex Hilbert space. Some parts of the 
considerations can be developed for real spaces and also for incomplete 
spaces. 

Let T' be a linear operator with range in X and with domain dense in 
X; this assumption is retained in all the following discussion. If y, z is 
a pair such that (Tx, y) — (x, z) when x e Z(T), we say y € Z(T*) and 
T*y =z. Thisdefines T*. We now describe things which can be proved, 
without giving the proofs. The adjoint operator T* is closed. If Z(T*) 
is dense in X, (T*)* = T** is defined and is an extension of T. This 
occurs if and only if T has a closed linear extension, and then T** is the 
minimal such extension. Hence T = T** if T is closed. 

If T is symmetric, T* is an extension of T, and hence Z(T*) is dense 
in X. The operator-T'** turns out to be symmetric, but T* is symmetric 
if and only if T* = T**. In general T* is a proper extension of T**. 
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If T is symmetric, Po(T) and Co(T) are confined to the real axis, but 
there may be nonreal points in Ro(T). However, if A is nonreal and in 
o(T), all points on the same side of the real axis as A are in Ro(T). The 
relation T* — T** holds if and only if o(T) is confined to the real axis. 


Definition. T is called self-adjoint if T = T*. 


If T is self-adjoint, it is closed, and o(T) is confined to the real axis. 
Conversely, if T is closed and symmetric and if o(T) is confined to the 
real axis, T is self-adjoint. 

If T is closed and symmetric, but not self-adjoint, the operators T + i 
have bounded inverses, and hence the ranges of these operators are closed. 
The dimensions of A(T — i)- and #(T + i)- are called the deficiency 
indices of T. 

Various investigations of symmetric operators may be made with the 
aid of operators called Cayley transforms. If T is symmetric, the Cayley 
transform of T' is the operator 

V-—(D-irT-iy. 
The domain of V is Z(T + i), and V maps this domain isometrically onto 
AT — i); Vis unitary if and only if T is self-adjoint. 

When T is self-adjoint, we can use the spectral representation of its 

Cayley transform to obtain a spectral representation of T and a 


generalization of the results of $6.5. Applying Theorem 6.6-B to V, let 
us write 


(Vx, y) = Í 7 eit d(F,x, y). 
0 


where F; is the resolution of the identity for V. The relation between V 
and T then permits us to deduce (after some details which we omit) the 
relation 


2a 
(67-1 (Tx, y)= — f ctn : d(F,x, y), x €Z(T), y e X. 


This integral is improper at 0 and 27. We then define E, = Fy, where 
A = — ctn (60/2). Then (6.7-1) becomes 


(Tx,y) = [ndm y. 


The family of symmetric projections E, has properties much as in Theorem 
6.5-A, but we have Ex ^ 0 as A— — oo, Ex > x as A — + oo, in place 
of property c in this earlier theorem. The domain of T consists exactly 
of those x for which 


ie à2 d(E,x, x) 
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is convergent; the value of the integral is then ||Tx|2. The behavior of 
E, near a particular Ag indicates the classification of this point in p(T) 
or o(T) just as in the bounded case. Finally, an operational calculus can 
be developed, generalizing Theorem 6.5-C. 


Example I. The operator A of Example 1, § 6.11 is self-adjoint. Its 
spectrum is made up of the points A, = n, n = 0, + 1, + 2,-++; A, is an 
eigenvalue corresponding to the eigenvector u,, where u,(s) = (27)-1/2eins, 
In this case the resolution of the identity corresponding to 4 is given by 


[LEQ,) agi E(A, SY 0)]x = (x, UpUp 
For x € Z(A) the formula 


[re] oo 


is just the same as the formula 
AX m f à dE,x, 
-0 


and x € Z(A) is equivalent to the convergence of 


(ij X d{E,x, x) = > n2|(x, ue. 


— 00 


The reader should refer to the discussion of Example 2, 8 5.7; there, 
however, E, is the operator now denoted by E(A,) — E(A, — 0). See 
also Stone, 1, pages 428-435. 


Example 2. Let X = L(— œ, oo). Let Z(T) be the subspace of X 
determined by those functions x(f) which are absolutely continuous on 
every finite interval, with x(t) and x'(f) belonging to .Z2(— œ, oo). Let 
Tx = y mean y(t) = ix'(r). The operator T is closely related to the 
operator S for which Sx = y means y(t) = tx(t), Z(S) being the subset 
of X for which x(t) and ¢x(r) are both in .Z?(— oo, oo). The operators 
S and T are self-adjoint, and T = FSF-1, where F is the Fourier-Plancherel 
operator (see Example 2, $ 6.6). The entire real axis belongs to o(T), and 
it is all continuous spectrum. The same is true for S. The resolution 
of the identity for S is given by Ex = y, where y(t) = x(t) if t < A, 
y(t) = Oif A « t. For T the resolution of the identity is given by 


œ gidr(s—t) — geiu(s-t) 


(E, — Ej)x(t) = E s i(s — t) 
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Anofher item of interest is the following, which relates to the 
operational calculus as it applies to T: Suppose fe .Z?(— oo, oo), and 
let g be the Fourier-Plancherel transform of f. Then the operator f(T) 
corresponding to fis given by /(T)x = y, where 


y) = = F g(t — s)x(s) ds. 


For details see Achieser and Glasmann, 1, pages 118-120 and 227—232 
and Stone, 1, pages 441-446. 
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INTEGRATION AND 
LINEAR FUNCTIONALS 


7.0 Explanatory Remarks 


In the earlier parts of this book we have from time to time referred to 
the function classes .Z? and the associated spaces L^. The functions in 
question were assumed to be defined and measurable in the Lebesgue sense 
on some measurable set in Euclidean space of one or more dimensions. 
The attendant integrals were Lebesgue integrals. A knowledge of 
classical Lebesgue theory would be sufficient to cope with these previous 
references to measure and integration. 

In modern analysis some form of general theory of measure and 
integration is essential for proper understanding of numerous develop- 
ments. Classical theory of functions of a real variable is being swallowed 
up by topology and abstract functional analysis. It is not one of the 
objectives of this book to develop the generalization of the Lebesgue 
theory in detail from its axiomatic foundations. Instead, we assist the 
reader not already acquainted with such generalizations by outlining one 
form which the development may take, leaving him to read the details 
elsewhere. The close relationship between the theory of integration and 
linear spaces is stressed, and the use of integrals in the representation of 
certain linear functionals is developed in detail. 
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Modern forms of the theory of measure and integration play a central 
role in the theory of topological groups and elsewhere in topological 
algebra, notably in certain parts of the theory of Banach algebras. 
Generalizations of the spectral analysis of self-adjoint and normal 
operators in Hilbert space are prominent in this respect. 

The sections prior to $ 7.3 are expository, with few proofs given. In 
§ 7.3 the space L^ is defined, and it is proved to be complete (Theorem 
7.3-A). Theorem 7.3-D is an important theorem about approximation 
of elements of L? by integrable simple functions. Theorem 7.3-E is a 
sort of converse of Hólder's inequality which is very important in proving 
the fundamental representation theorem for continuous linear functionals 
on Lr (Theorems 7.4-A and 7.4-B). 

The next portion of the chapter ($8 7.5-7.7) is devoted to the study of 
measures in Jocally compact Hausdorff spaces and the representation of 
linear functionals on certain spaces of continuous functions. If T' is the 
Hausdorff space and C«(T) is the normed linear space of all real-valued 
continuous functions on 7, with compact support, the relation between 
regular Borel measures on T and positive linear functionals on C.{T) is 
sketched, with reference to other sources for proofs. After a discussion 
of signed Borel measures and vector lattices, we come ultimately to the 
fundamental theorem (7.7-G) which identifies the normed conjugate of 
Ca(T) with the vector lattice of finite regular signed Borel measures on 
T (i.e., on the o-ring of Borel sets in T). 

Finally, in $ 7.8 and 8$ 7.9 we obtain representation theorems (7.8-A 
and 7.9-A) for continuous linear functionals on spaces, respectively, of 
bounded and essentially bounded functions. These representation 
theorems involve integrals with respect to finitely additive set functions. 


7.| The Space L(u) 


In defining the integral of a real-valued function with respect to a 
measure » we follow the exposition of Halmos, 2, Chapters II, IV, V. 
The reader will need to have some familiarity with general measure 
theory and with the general form of the theory of integration with respect 
to a postulated measure. Our primary aim in this section is to view the 
definition of the class of integrable functions as a process of completing 
anormed linear space. In order to assist the reader who is not thoroughly 
acquainted with the theory of measure and integration from the point of 
view taken here, we indicate the principal definitions and steps in the 
development of the theory. For proofs the reader can refer to the book 
of Halmos or to other standard texts. 
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Definition. A nonempty class R of sets is called a ring if EU F and 
E — F belong to R whenever E and F do. The ring is called a o-ring if 
it contains the union of every countable collection of its members. 


A ring contains the empty set, and it contains the union and intersection 
of any finite number of its members. 


Definition. A measure is a function p defined on a ring R, the values 
of u being either real numbers or + oo, subject to the conditions 


a. WE) 2 Oif EER. 
b. a) = 0. 
c. If {E,} is a sequence of pairwise disjoint members of R whose union 


is in R, then 4 U 2 = » u(E,,) (with the usual conventions about + oo 


n=] nzl 


in relation to the series). 


A measure also has the following properties, as a consequence of the 
definition: 


d. If E, Fe Rand Ec F, then (E) < pF). 
e. In the situation of (d), if u(E) < oo, then (F — E) = (F) — (E). 


Definition. If T is any nonempty set, if S is a o-ring of subsets of 
T such that T is the union of all members of S, and if p is a measure 
defined on S, we call (T, S, p) a measure space. The members of S are 
called measurable sets. 

The set T itself need not belong to S, and the complement of a 
measurable set need not be measurable. 

For the development of the theory of integration based on a measure 
space it is not necessary to know where the measure came from. In 
various particular instances of the abstract general theory it is usually the 
case that a measure is constructed from some set function that has some, 
but not all, of the properties of a measure. 


Example l. If T is Euclidean space of n-dimensions, S is the class of 
Lebesgue measurable sets in T, and u is Lebesgue measure, then (T, $, 4) 
is a measure space. In this case TeS and p(T) = +œ. The ring S 
and the measure p are constructed by starting with the definition and 
construction of an outer measure. 


Example 2. Let T be the set of positive integers, S the class of all 
subsets of T, with (E) equal to the number of elements in £ (either an 
integer or + oo). 

A measure space determines a class of functions called integrable, and 
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with each such function x there is associated a real number, called its 
integral, and denoted by 


Í x du or [s dy. 
T 


We frequently omit the symbol T on the integral sign, if the context is 
such that there is no ambiguity. In order to define the class of integrable 
functions we begin with the concept of a measurable function. This 
concept involves only T and S, not the measure y. 

First we must define ‘‘ Borel set of real numbers." We give the definition 
so that it can be used for any locally compact Hausdorff space. 


Definition. If Cis the class of all compact subsets of a locally compact 
Hausdorff space, the elements of the smallest o-ring containing C are 
called the Borel sets of the space. This smallest o-ring is the intersection 
of all o-rings which contain C. 


For Euclidean space an equivalent definition of the Borel sets is 
obtained if we use the class of all open sets instead of the class of all 
compact sets. 

Now consider functions x defined on 7, with values x(t) in the set 
consisting of the real numbers and the symbols + oo, — oo. We define 
N(x) as the set of t € T such that x(t) z 0. 


Definition. The function x is called measurable (with respect to S) if 
N(x) A x-1(M) € S for each Borel set M of real numbers and if also the 
sets {t:x(t) = +æ}, {t: x(t) = — oo) belong to S. 

If T belongs to S and if all values of x are real (not + œ), it can be 
shown that x is measurable if and only if x-1(M) € S for every Borel set M. 

This definition of measurability is equivalent to the definition of 
measurability in the classical Lebesgue theory for the case in which T is 
Euclidean space and p is Lebesgue measure. 

For the (T, S, u) of Example 2, all functions are measurable. 

If E € S, the characteristic function of E is measurable. We denote it 
by xg. For convenience in printing it is best to avoid subscripts on 
subscripts whenever possible; hence, we shall write xg, for the 
characteristic function of E,. 


Definition. The function x is called simple if there exists a finite 
collection of pairwise disjoint sets E, - - -, E, in S such that the value of x 
on E, is a real constant e, (not +œ) and the value of x is 0 on 
T —(EQU---U E) Then x = ejXga) o c: + OX En): 


The simple functions form a real linear space. The absolute value of 
a simple function is simple, and the product of two simple functions is 
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simple. It is frequently useful to know that, if x is measurable, there 
exists a sequence {x,} of simple functions such that x,(1) — x(t) for each 
t€ T. If x(t) 2 0 for each f, it may be arranged to have x(t) > 0 and 
x.t) X Xyaat). 


Definition. A simple function x is called integrable if u[N(x)] « oo. 
If x is an integrable simple function with the distinct nonzero values 


94, *:*, €p assumed on sets £j, +--+, E, respectively, the integral of x is 
defined to be 
(1.1-1) [x de = eani) + +++ + aE). 


If x(r) = 0, we define the integral of x to be 0. 


It is easy to see that the integrable simple functions form a linear space 
and that the integral is a linear functional on this space. It is also easy 
to see that 


(1.1-2) | fx du < [Ix du. 


If x is an integrable simple function and E € S, the product function 
Xxg is also simple and integrable; we define the integral of x over the set 
E as 


(7.1-3) I x dis Í xxg du. 
E T 


If x and y are measurable functions, we write x(t) =° y(t) and say that 
x(t) = y(t) almost everywhere (abbreviated as a.e.) provided that the 
measure of the set (1: x(t) # y(r)) is0. Itis clear that =°? is an equivalence 
relation on the class of integrable simple functions and that we can form 
a linear space whose elements are equivalence classes of integrable simple 
functions. Equivalent functions have equal integrals. A function x is 
equivalent to the identically zero function if and only if f[x| du = 0. It 
then follows easily that the space of equivalence classes becomes a normed 
linear space if we define the norm of an element of the space to be J|x| du, 
where x is any member of the equivalence-class element. All of this 
depends on just a few of the elementary properties of integrals of 
integrable simple functions. 

Let us denote by W the normed linear space of equivalence classes of 
integrable simple functions, as described in the foregoing paragraph. 
For convenience we ignore the notational distinction between an integrable 
simple function and the equivalence class to which it belongs. It is clear 
from (7.1-2) that the integral is a continuous linear functional on W. 
If W is the completion of W, the integral, as a continuous linear functional 
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on W, has a uniquely determined extension which is a continuous linear 
functional on W. Our aim is to show how W can be regarded as a 
space whose elements are equivalence classes of functions more general 
than the integrable simple functions. These functions are what we call 
integrable (but not necessarily simple) functions, and the extended linear 
functional defines the integral for such functions. 

The essential concept which is needed at this stage is that of convergence 
in measure. 


Definition. A sequence {x,} of measurable functions whose values 
are a.e. finite (i.e., real, not + oo) is called a Cauchy sequence in measure 
if for each e > 0 the measure of the set (t:|x,(r) — x,,(f)| 2 e} converges 
to 0 as m and n become infinite. If x is a function of the same type as 
the x,'s, the sequence is said to converge to x in measure if for each 
e > 0 the measure of (t:|x,(r) — x(t)| 2 e} converges to 0 as n> oc. 
For brevity we write 

X,— X470 and x,>x 
respectively in these situations. 


It is not a complicated matter to show that, if x, ^ x and x, ^ y, 
then x(t) =° y(t). A sequence is Cauchy in measure if and only if it 
has a limit in measure. 

Suppose now that {x,} is a sequence of integrable simple functions such 
that 


[len — xnl de > 0 as m and n — oo. 


If Emn = {t:|x,(t) — x,()| 2 €), it follows that 


fixa- xml de [ob m Xml du > Em), 
and so {x,} is Cauchy in measure. Hence there exists a measurable and 
a.e. finite valued x such that x, > x. Next, suppose that {y,} is a sequence 
of integrable simple functions such that 


[lon — ul de > 0 as m, n — oo, 


and hence, for a certain y, y, y. Suppose also that f|x, — y,| du — 0. 
Then it is easy to show that x(t) =° y(t). Conversely (and this is more 
difficult to prove), if {x,} and {y,} are sequences of integrable simple 
functions such that |x, — x,| du —>0, fly, — ¥ml du — 0, x, x, 
Ya y, and x(t) =° y(r), then 


(7.1-4) Js — y,| du — 0. 


We shall prove this converse assertion. 
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First we note that to each e > 0 corresponds a 5 > 0 such that for all n 
f Ix,Jdu<e — ifg(F) « & 
F 


A similar thing holds for {y,}. See Halmos, 2, Theorem C, page 100. 
Now, for any given e > 0, let 


E, = {t:|x,() — »«0| 2 e F, = {E |x) — x()| 2 «3, 

G, = {t:\ y(t) — WO] > €/3}, H = {t:|x() — yj 2 93). 
From the inequality 

be) — »«0| « px — xt) + 1xX) — VOL + (PO — rn 


itis clear that E, cC F, U G, U H, and hence that «(Ej) < u(F,) + &(G,) + 
p(H). But &(H) = 0 and p(F,) — 0, &(G,) — 0, whence &(Ej,) — 0. If 
now E is any measurable set of finite measure and D, = EM E,, we have 


f [Xn = A dy X f [Xn = A dy + Í RA du ‘+ | BA du, 
E E-E, Dy Dg 


The first term on the right does not exceed «epQ(E). Then, since 
p(D,) € (E) — 0, we see that 


f [3s E nl dy — 0 
E 


for every measurable set E of finite measure. 
Next, if E is any measurable set, the limit 


HE) = lim | Ix, = dnl de 
n—»4 E 
exists, as is evident from the inequality 


Jf, (l= Yal = lem = Yad) el < 


(ie — Xml du + [is — Yml du. 


It is easily proved that v is a countably additive set function on S; we 
omit the details of this part of the argument. Since w(£E) = 0 if u(E) is 
finite, it follows that (E) = 0 if E is any countable union of sets of finite 
measure. In particular, (£) = 0 if E is the union of all the sets N(x,), 
N(y),n —1,2,---.. With this last meaning of E we have 


a IX, n Yal du = f |x, = Yl du — (E) = 0. 


Thus (7.1-4) is proved. 
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A consequence of the conclusion just reached is that, with {x,} and 
{Yn} as given, 


(7.1-5) lim [x, dy = lim f y, dp. 


n-»o 


The limits exist, for 


|[». du — fende] < f^ — Xml du — 0, 


and likewise for the integrals involving {y,}. The truth of (7.1-5) follows 
from 


| fos du x fondul < Ts — y,| du > 0. 
This brings us to the general definition of an integral. 


Definition. An a.e. finite-valued measurable function x is called 
integrable if there exists a sequence of integrable simple functions {x,} 
such that 


(7.1-6) f^ ~x,|du>0 and x 
The integral of x is then defined as 
(7.1-7) f x du = lim f x, dp. 


The foregoing considerations justify this definition by showing that the 
limit in (7.1-7) exists and has the same value for any choice of {x,} 
satisfying (7.1-6). Moreover, equivalent integrable functions have equal 
integrals. It is easily verified that the integral in (7.1-7) has the same 
value as that defined earlier if x happens to be simple and integrable; 
in that case we can take x, — x for every n. 

Suppose that x is an integrable function which originates from the 
sequence of integrable simple functions {x,} as in (7.1-6). Then |x| 
originates in the same manner from (|x,|); therefore |x| is integrable, and 


(7.1-8) | |x, du > f |x| du. 


We can conclude from this that f|x| du = 0 implies x(t) =°0. For, it 
certainly implies x, ^ 0; since x, > x also, we have x(t) =° 0. 

We denote the class of integrable functions by .Z(u) The set of 
classes of equivalent integrable functions is denoted by L(u); L(u) is a 
normed linear space with f|x| du as the norm of the element corresponding 
to the integrable function x. 
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We leave it for the reader to verify in detail the correlation between 
the process of completing the space W and our procedure in defining 
L(p) and L(u). This correlation shows that L(y) can be identified with 
the completion W. We know that W is dense in W and that W is 
complete. In terms of functions, these facts can be stated as follows: 
If x is integrable, there exists a sequence (x,) of integrable simple functions 
such that j|x, — x| du — O0. If {yn} is a sequence of integrable functions 
such that f| y, — Yml du — 0, there exists an integrable function y such 
that §|y, — y| du — 0. 

By using Lebesgue's theorem on dominated convergence (Halmos, 2, 
Theorem D, page 110), it is easy to prove the following: 7f x is measurable 
and |x(t)| < y(t) a.e., where y is integrable, then x is integrable. In 
particular, if constant functions are integrable, then every bounded measurable 
function is integrable. A constant function on T is integrable if and only 
if T is measurable and (T) is finite. : 


PROBLEMS 


l. With (T, S, p) as in Example 2, show that convergence in measure is the 
same as uniform convergence. 


2. With (T, S, p) as in Example 2 and functions x on T expressed as sequences 


x = (£, discuss the meaning of "simple function, integrable simple 
function," and “integrable function.” Show that x is integrable if and only 


if > |£| < v. What is fx du? 
1 


3. If (T, S, p) is a measure space and z is a complex-valued function defined 
onT, letz = x + iy, where x and y are real valued. We say that z is measurable 
if x and y are both measurable, and likewise for integrability. If z is integrable, 
we define its integral as 


fzdp = fody + i fy du. 
Show that |z| is integrable if z is. Show that, if z is integrable, there exists a 
sequence {z,} of integrable simple functions such that f|z, — z| du — 0. 


Discuss (u) and L() for complex functions, and show that L(u) is a complex 
Banach space. 


7.2 Signed and Complex Measures 


It is useful to generalize the concept of a measure by allowing the 
function p to assume values which are negative or complex. However, 
to avoid the ambiguity of oo — oo, it is necessary to require that p can 
take on at most one of the values + oo, — oc. 


374 INTRODUCTION TO FUNCTIONAL ANALYSIS [$7.2 


Definition. Suppose T is a nonempty set, S is a o-ring of subsets of 
T such that T is the union of all the members of S, and y is a function on 
S with values in a set consisting of all real numbers and just one of the 
symbols +œ, — oo. Then, if u(0) = 0 and if p is countably additive, 
p is called a signed measure, Being countably additive means that, for 


each sequence (E, of pairwise disjoint members of S such that U EES, 


then ( Ü 2 = » p E,). 


n=l n=1 
When we speak of a measure without a qualifying adjective such as 
“signed” or “complex” we mean a measure in the sense defined at the 
beginning of 8 7.1. 
With a signed measure u we can associate two measures u^, u^ defined 
as follows: 


HE) = E 
(7221) t CE) SUB AT) 
p (E) = — inf «(F), 
where F varies over all members of S such that F c E. It turns out that 
(7.2-2) iE) = p(B) — wE). 


This formula expresses what is called the Jordan decomposition of p (see 
Halmos, 2, pages 120-123, especially problem 3, page 123; see also 
Saks, 1, pages 10-11). If & happens to be a measure (i.e., if u(E) > 0 
always), then u = g^. 

We define a function || by the formula 
(7.2-3) ju|(E) = 4E) + p(B). 
This function is a measure on S. It is called the total variation measure 
associated with u. Observe that |&|(E) is in general not the same as 
|u(E)|. It can be proved that |u| is obtainable from p in a different 
way. If Ee S, let mg denote any finite collection of pairwise disjoint sets 
Ei, <+, E, from S such that E, c E. Then it can be shown that 


(7.2-4) lulE) = sup > HE. 
E k=1 


A signed measure is called finite if all the values of » are real numbers 
(not +œ or — oo). When p is finite, |u| is finite also, and the values of 
|u| are bounded, as a result of the fact that S is a o-ring. The class of 
finite signed measures becomes a real linear space in an obvious way. 
The function defined by 


(7.2-5) lil] = sup |u|(E) 
EeS 
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is a norm on this space of measures, and it is easy to prove that the space 
of measures is complete (see problem 1). 

Let u be a signed measure, and let x be a real-valued function which is 
defined on T and measurable with respect to the o-ring S. If x is 
integrable with respect to ||, it is readily seen that x is also integrable 
with respect to u* and u-. We then define the integral of x with respect 
to » by the formula 


(7.2-6) fx du = fx dut — fx du-. 
It is easily shown that 
(7.2-7) | fx du < {|x| dial. 


Definition. If T and S are as in the definition of a signed measure, 
by a complex measure we understand a function u = u; + ip, where 
pı and p3 are signed measures on S. 

For a complex measure we can define the associated total variation 
|u| by (7.2-4). It turns out that |u| is a measure. If p; and p are 
finite we say that u is finite. Finite complex measures form a complex 

: Banach space with the norm defined by (7.2—5). 

We can define integrals with respect to a complex measure u. Let z 
be a complex-valued function defined on 7, and let z = x + iy, x and y 
having real values. Suppose that x and y are integrable with respect to 
|u|. Then they are also integrable with respect to |u;| and |u;], and we 
define 


(7.2-8) [edu = fx dm - fy dm + i [yd + i [x duz. 


The inequality (7.2-7) is valid with u a complex measure and x replaced 
by a complex-valued function z. Likewise, the result of problem 2 
extends to the case of complex functions and complex measures. 


PROBLEMS 


l. Let {u,,} be a sequence of finite signed measures such that /u, — pm! > 0. 
Show that lim ju, (E) = u(E) exists uniformly with respect to E, that u is a 
nx 
finite signed measure, and that ‘yp, — gu — 0. 
2. If x is a signed measure and |u|(E) < œ, show that 


[^s 
I E 


|u|(E) = sup 


BIES 


(supremum over all real-valued |u|-integrable functions x for which |x(7)| < 1 
on T). Use (7.2-7) and (7.2-4). The integral over E is defined by (7.1-3). 
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7.21 The Radon-Nikodym Theorem 


Suppose that (T, S, u) is a measure space and that x is an integrable 
function with values which are either real numbers or +œ (x is 
necessarily a.e. finite valued). Let 


(7.21-1) XE f xdu  EeS 


It is known from the theory of integration that v is a finite signed measure. 
It is also known that (E) = 0 implies (£) = 0. 
We now consider a converse situation. 


Definition. A signed measure v on the o-ring S is said to be 
absolutely continuous with respect to the measure p on S if (E) = 0 
whenever (E) = 0. If v is a finite signed measure, it can be shown that 
this requirement is equivalent to the requirement that to each e > 0 
correspond a à > 0 such that |w(E)| < e if (E) < 8. 

In $ 7.4 we shall need the following theorem: 


Theorem 7.21-A. (Radon-Nikodym). Suppose that ,T itself is 
measurable and that it is the union of a countable family of measurable sets 
of finite measure. Let v be a finite signed measure which is absolutely 
continuous with respect to the measure p. Then, there exists an integrable 
function x such that v(E) is given by (7.21-1). 


For a proof of this theorem the reader is referred to Halmos, 2, 
Theorem B and proof, pages 128-130. We have stated the theorem in the 
form appropriate for our use, which is not the most general known form 
of the theorem. 


7.3 The Real Space L^(1) 


Let (T, S, u) be a measure space as in $7.1. If p > 0, a measurable 
function x is said to belong to #(u) if |x|? is integrable. We can argue 
just as in Example 7, § 1.2, to show that #?(u) contains the sum of any 
two of its members. We denote by L(x) the linear space whose elements 
are the classes of equivalent members of .Z»(u) If p > 1, the space 
L*(u) becomes a normed linear space with 


(7.3-1) xl = (fale du)” 


as the norm of the element represented by the function x. The 
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inequalities of Hólder and Minkowski are valid for these general Lr(u) 
spaces (see Halmos, 2, pages 175-176). We drop the superscript altogether 
if p = 1. From now on we confine attention to values of p such that 
p2 1l. For convenience we write #? and L” instead of L?(p) and L(y). 


Theorem 7.3-A. If p > 1, the space L’ is a Banach space (i.e., it is 
complete). 


PROOF. For p = | the result is known from $7.1. For the general 
case we have to prove the following: Suppose {x,} is a sequence of 
members of £r such that 


(1.3-2) [lee — xml? da—>0 as mand n> oo. 
Then there exists a function x € X? such that 
(1.3-3) [i xp du00 asn— o. 
Now, (7.3-2) implies that {x,} is a Cauchy sequence in measure. For, 
if e > 0, let Emn = (t:|x(r) — x,()) 2 ej. Then 
[Ex — Xml? du > eis). 


and the result follows. Hence there is a measurable function x such that 
Íx,) converges in measure to x. Also, a subsequence converges a.e. to 
x(t). Denote this subsequence of {x,} by {u,}. If e > 0, choose 
K = K(e) so that 


flu- uode «e ifjandk > K. 


For a fixed j > K let y, = lu; — u,|*, y = |u; — x|. Then yA) > »(n) 
a.e., and 


IET € 


if k 2 K. Hence, by Fatou's lemma (Halmos, 2, Theorem F, page 
113), y is integrable and 
f> du & e. 


This shows that u; — xe? if j > K. Thus xe? also. We also 
conclude that 


fiu — xP du > 0 as j — oo. 


From this, using (7.3-2) and Minkowski's inequality, we deduce (7.3~3), 
by the same argument as in showing that, if a subsequence of a Cauchy 
sequence has a certain limit, the whole sequence has this limit. 
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In working with the space L? it is often convenient to know that the 
elements of Lr which correspond to integrable simple functions are 
everywhere dense in the space. We prove this by an argument in several 
stages. (For p = 1, of course, this result is implicit in the very definition 
of Z). Observe that a simple function is in ¥? if and only if it is 
integrable. 

In what follows the reader will need to recall that N(x) = {t: x(t) z 0}. 


Lemma 7.3-B. If x € £?, there exists a sequence (x,) with x, € £P, 
LINX] « oo, |x.(0| € |x(t)| for every n and t, and ||x, — x|| — 0. 


PROOF. It is known (Halmos, 2, Theorem F, page 105) that for any 
integrable x the set N(x) is contained in the union of a countable family 
of measurable sets of finite measure. Since N(x) is measurable, we can 
then express N(x) as the union of a countable family of pairwise disjoint 
sets of finite measure. Now N(x) = N(|x|»), and so this applies to x if 


xer, Hence let N(x) = U E, be such a representation of N(x). 
n=] 


Now define x, by 


oe x(t) on EU. U E, 
"o o elsewhere in T. 


Let N(|x, — x|) = F,; note that F, © N(x) — (ELU -U E). Now 
x, E Fr, because |x,| < |x|. Then 


xn = Ida = [ x|? du < NEZ 
Joc side = edes D f, lated 


k=n+1 
But 


xede = Í x|? dp = i x}? dp, 
fiede = J. ed > E 


the series being convergent, since an integral is a countably additive set 
function. Therefore it is clear that |x, — xl, — 0. Also, N(x,) c EU 
"eU Ep, so that u[N(x,)] < œ. This finishes the proof. 


Lemma 7.3-C. If xe £? and e > 0, there exists y € Lr such that 
LINO] < œ, |Ð] < |x(D| for each t, the values |y(t)| are bounded, and 
ly — xl < e. 


PROOF. We first choose z € £r as one of the x,'s in Lemma 7.3-B so 
that |x — zil < e/2. We shall now show how to choose y € £? so that 
INO] < oo, |y| < |z|, the values of | y| are bounded, and |z — yi, < «/2. 
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The y will then have the properties we seek, by Minkowski's inequality. 
Let us define z, by 


EO EOS? 
a z(t) = t sgnz(r) if |z()| > n. 


(See 84.32 for the meaning of sgn.) Then z, is measurable, |z,| < n, 
and |z,| < |z|. Note that N(z,) = N(z), whence p[N(z,)] < ov. Let E, 
be the set where |z(r)| > n. Then 


fizpdu > f cire > ma. 
En 


and so u(E,) — 0. Then 
fin- zede = fn m nde f ded leDede < 2 [cina 
E, En En 


From this it follows that |z, — zl, — 0. We can choose y as z, for some 
n large enough to make ||z, — zl, < e/2, and the proof is complete. 


Theorem 7.3-D. fx € Lande > 0, there exists an integrable simple 
function y such that | y(t)| < |x(t)| + e for all values of t, and |x — yl, < €. 


PROOF. By Lemma 7.3-C we can choose z € £’ so that u[N(z)] < oo, 
z is bounded, |z| < |x|, and |x — zl, < e/2. Then we show how to 
choose an integrable simple function y such that |y| < |z| + e and 
|z — yl; < «/2. This will be enough to prove the theorem. 

Let A = sup |z(f)|. Divide the interval (— A, A) of the real axis into 
n equal parts by points a, a, ++, &, where — A =ag <a, <--- 
<a, = A. We define z, as follows: z,(f) = 0 if z(t) = 0, and, if 
z(t) # 0, then 


n E if eg < i 


k if aR < z(t 


ay 


< 
S M415 k=], n-li. 


Then N(z,) € N(z), and z is an integrable simple function. It is evident 
that |z, — z(t)| < 24/n for every t. Then 


fiz ird Toco — z|? du < 2A/n)? HING) 


and |z| < |z()]| + (2A/n). By taking n large enough the choice 
y = z, will be satisfactory. 

. We shall presently need the following theorem, which is a sort of 
converse of Hólder's inequality; we adopt the notation of $4.32 as 
regards p and p’. 
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Theorem 7.3-E. Suppose 1 < p< œ. Suppose that T itself is 
measurable and that it is expressible as a countable union of measurable sets 
of finite measure. Let y be a real-valued function which is defined a.e. on 
T. Suppose the product function xy is integrable whenever x is a bounded 
and measurable function on T such that u[N(x)] < oo. Moreover, suppose 
that there exists a real constant M such that 


(7.3-4) | [xy du| < Mil 
for every such x. Then y € £?' and 
(7.3-5) i |y]? du < Mr. 


PROOF. Let E be any measurable set of finite measure, and let xg be its 
characteristic function. Then xgy is integrable, by hypothesis. Let 


oo 
T- U E,, where the sets E, are measurable, pairwise disjoint, and of 
n=1 


finite measure. Let F(n) = E;U---UE,, and define y () = y(t) on 
F(m, yt) =0 on T — F(n).. Then y, = yXpqy is measurable, and 
yt) — y(t) a.e., so that y is measurable. In what follows we shall 
prove that x,| y|” is integrable for every E of finite measure, and that 


(7.3-6) | xel y|” du < Mr. 


It will then follow by Fatou’s lemma that y € £r and that (7.3-5) holds, 
for, in the notation used above, 


XE DIVO > H| ae. 


If E is any set of finite measure, define x,(t) = 0 if te T — E, and, if 
t € E, define 


x,(t) = O- sgn pO) if [XH] « nv» 
"I^ — (nU? sgn y(t) if |y) > nur. 


Then x, is measurable, |x,| < nz, N(x,) = N(y) O E, and so u[N(x,)] < 
oo. Also,ifte€E, 


, [b EOF <n 
Ix (ol = 4. if [yO > n, 


and 
lyn? if |y” <n 


XÐ) = nul y(t)| if | (|? > n. 
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Note that x (Oy) > |x (A|? for every t. Therefore, by (7.3-4), 


[xt du < ]x» du < M(f ixl du)”, 
and it follows that 
(f Ixl? du)” < M. 


But |x (D| > xg(f)| y(2)|? a.e. Therefore, by Fatou's lemma, xg| y|” is 
integrable and (7.3-6) holds. In view of remarks made earlier, this 
completes the proof. 


PROBLEMS 


l. In Example 6, $3.11, we defined the function class -Z? and the space L® 
for the case of Lebesgue measure on the real axis. These definitions can be 
extended at once, and we obtain .Z*(u) and L®(y) in relation to an arbitrary 
measure space (T, S, u). Show that L®(u) is complete. 

2. Let the assumptions on y be as in Theorem 7.3-E, except that now we 
assume p = 1. Then we can conclude that y € #®() and that sup? | (| < M. 

3. State and prove a theorem corresponding to Theorem 7.3-E for the case 
p = c, p’ = 1, the conclusion being that y is integrable and f|y| du < M. 

4. Let M be the class of sets of finite measure in S. Let 4 be a binary 
operation on sets, defined as follows: 


EAF = (E — F) U (F — E) = (EU F) - (EO F). 


If E and F are in W, let d(E, F) = u(EAF). Then, with d(E, F) as distance 
between E and F, W is a complete metric space (see Halmos, 2, pages 168—169). 

5. With M the metric space defined as in problem 4, show that L?(j) is 
separable if 9è is separable and if | < p < oc. Start with a countable dense 
subset Yo C M. Then finite linear combinations with rational coefficients, of 
characteristic functions of members of Wo, lead to a countable dense subset of 
L(y). Use Theorem 7.3-D. 

6. Let (T, S, u) be a measure space such that T e S and T is a countable 
union of measurable sets of finite measure. Furthermore, assume that there is 
a countable collection of members of S such that S coincides with the smallest 
o-ring containing this collection. Then the metric space W defined in problem 
4isseparable. See Halmos, 2, Theorem B, page 168. Show that the conditions 
here imposed on (T, S, p) are fulfilled if T is a Lebesgue measurable subset (not 
necessarily proper) of Euclidean space of n-dimensions and p is Lebesgue 
measure on the measurable subsets of T. Hence L^(p) is separable in this case. 


7.4 Continuous Linear Functions on L? 


We work with L? as defined in $7.3. To begin with it is convenient 
to assume T € Sand p(T) < co. This restriction is partially relaxed later. 
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Theorem 7.4-A. Supposel € p < oo. Suppose T € S and p(T) < oo. 
Then there is a one-to-one, linear, norm-preserving correspondence between 
the normed conjugate space of Le and the space L”, such that, if x’ e (LPY 
and y € Zr is a function which represents the element of L? corresponding 
to x', we have 


(7.4-1) x(x) = I xy du 


for each x e £r. The norm-preserving feature of the correspondence means 
that 


(1.4-2) We'll = (fiy ad)" 
if i < p, and 
(7.4-3) i|x’\| = sup? | (| 


in case p = | (in which case p' = œ). 


PROOF. Let us start with y € .Z» and define x’ by (7.4-1). Then x' is 
linear and continuous, with |x'| < |y|;. This inequality comes from 
Hólder's inequality if 1 < p < oo and from the fact that |x()y(0| < 
Ix()] lylo a.e. in case p = 1, p' = œ. The mapping y x' plainly 
defines a continuous linear mapping of L” into (L^). Also, it is clear by 
Theorem 7.3-E if 1 « p, and by problem 2 of $7.3 if p = 1, that if 
x'(x) = 0 for every x, then ly; = 0 and so y(t) = 0 ae. Thus the 
mapping is one-to-one. It remains to prove that every x’ e (L») is the 
image of some y € L” and that ||x’|| = liy]. 

So, suppose x’ €(L?)’. For any Ee S let (E) = x'(xg), where xg is 
the characteristic function of E. Note that ||xg||, = [n(£)]'/. Hence 


(7.4-4) «(I < IKIE.. 


The set function v is finitely additive; for, if E and F are disjoint 
measurable sets and G = EU F, we have xg = xg + xg, whence 
(EU F) = WE) + v(F). The countable additivity of » can now be 
proved with the aid of (7.4-4). Suppose (E,) is a sequence of pairwise 
disjoint measurable sets. Then, if 
F, = E- |] Ev 
k=1 


Il 
= 
D 
gu 
a. 


E 
we have 


(E) = > WE) + YF). 


k=1 


But p(F,) — 0, since p is countable additive, and hence »(F,)— 0, by 
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(7.4-4). Therefore v is countably additive. It also follows from (7.4-4) 
that v is absolutely continuous. We can now use the Radon-Nikodym 
theorem to assert the existence of an integrable function y such that 


HE) = [vd 
E 
for every Ec S. Since (E) = x'(xg), it now follows at once that 
(7.4-5) x(x) = fo du 


for any simple function x. We wish to show next that this same formula 
holds for any bounded measurable function. If x is bounded and 
measurable (and hence in .£?), Theorem 7.3-D shows that there exists a 
uniformly bounded sequence {x,} of simple functions such that 
|x, — xl, — 0. The proof of Theorem 7.3-D shows that for the case 
now before us, in which x is bounded and p(T) < œ, we can also require 
of the sequence (x,) that x,(f) — x(t) for each t. It then follows by 
Lebesgue's theorem of dominated convergence that 


[x du — [xy du. 


Thus, since x'(x,) = [x,y du, we see that (7.4-5) holds for every bounded 
measurable x. Since |x’(x)| < |x'||ix|,, the converse of Hdlder’s 
inequality tells us that y e £” and ||ylj < ||x’|| (Theorem 7.3-E if | < p, 
problem 2, 8 7.3ifp = 1). Finally, since the elements of L? corresponding 
to bounded x are dense in L? (Lemma 7.3-C), and since [xy du defines a 
continuous linear functional on all of L? (now that we know y e .Z7), it 
is clear that (7.3-5) is valid for all x € Zr. We showed that ||x'| < ilylly 
at the outset. Hence ||x’|| = ||yily, and the proof is complete. 
We now relax the condition (T) < oo. 


Theorem 7.4-B. Theorem 1.4—A remains true as stated if the hypothesis 
that (T) < oo is replaced by the hypothesis that T is the union of a countable 
family of measurable sets of finite measure. 


PROOF. Let G be any fixed measurable set of finite measure. Those 
elements E € S such that E C G form a o-ring containing G, and, if we 
restrict u to these sets E, it is a measure on this new o-ring. Let us write 
-»(T) and £G) to distinguish the function classes which arise when we 
talk about functions defined over T and G respectively, using the measure 
p. and its restriction as just described. If g is a function defined on G, let 
us denote by g* the function defined on T by 


4AL g(t) on G 
eo - 4 on T — G. 
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Evidently g € £(G) implies ge € »(T) and 


f iede = iere. 
G T 


Let us now suppose that x’ is a continuous linear functional on L/(T). 
If g € .Z»(G), let us define f(g) = x'(ge). It is easily verified that f is a 
continuous linear functional on L(G) and that, as such, its norm satisfies 
the inequality ||f|| < lxil. By Theorem 7.4-A there exists a function 
y € Lr (G) such that 


fe) = | av de 
for each g € .Z»(G). Moreover, |y]; = IfI < Ixi. 


L [s] 
Now let us write T = U E,, where E, has finite measure. Let 
n=1 
G, = E;U-++-UE,. We apply the foregoing reasoning to each G, and 
obtain corresponding functionals f, and functions y,. For any fixed n 
suppose g € .Z»(G,), and let h be the restriction of ge to G,,,. Then 
ge = he, and we have 


f erdu =x) = x0) = [verde = [ made 
Gy Gait Gg 


The last equality comes from the fact that A(t) = 0 on G,,, — G,. We 
thus have 


Í 8X, — Yni) du = 0 


for each g € .Z»(G,). From this we conclude by Theorem 7.4-A that 
Yt) — Yui) = 0a.e. on G,. Hence, if for each ! we define y(t) = y,(1), 
where m is the smallest integer for which t € Gm, we see that y(t) = y,(t) 
a.e. on G, for each n. We can conclude that y e #?(T) and |lyliy < lx". 
If p' = oo(p = 1), this is immediate, for we know that 


sup LXX] = i^ < Iix'l 


for each n, whence sup? | y(t)| < |x'|. I£ p' < oo (1 < p), we have 
] teG 


Jim de = [pur de = lr < tr, 
Ga Ga 


and the desired result follows by application of Fatou’s lemma to the 
sequence »,| y|?” (where v, is the characteristic function of G,). 
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Finally, suppose x € X(T), and let g, be the restriction of x to G,. 
Then g,? = xv,, and so 


x'(xv,) = f.(g;) = is EnYn de = [o dy. 
But 
fi — x|? dp = f |x|? du — 0, 
T-G, 


as a result of the fact that the set function Í |x|? du is countably additive. 
E 


It then follows that x'(xv,) — x'(x), since x' is continuous. It also 
follows, by Hólder's inequality, that 


IE dy — [xy dy. 
Thus we find that x'(x) = J xy du for every x e .Z»(T). 


We have now shown that each x’ determines a ye Zr with 
lylly < lx’. That each such y determines an x’ with [ix'|| < |y, and 
that the correspondence between x' and y is one-to-one are shown as in 
the proof of Theorem 7.4-A. This finishes the argument for Theorem 
7.4-B. 

For a discussion of the L? spaces and of the representation of continuous 
linear functionals on them, using the Daniell approach to the theory of 
integration, see Loomis, 1, Chapter III, especially pages 41-43. If 
1 < p< œ, but not if p = 1, Theorem 7.4-A can be extended to the 
case in which (T, S, p) is any measure space. The key fact is that for 
any x € L(u) the set M(x) is contained in a countable union of measurable 
sets of finite measure (Halmos, 2, Theorem F, page 105). 


PROBLEMS 


I. Under the conditions on T stated in Theorem 7.4-B, Lr is norm reflexive 
if 1«p« o. 


2. Discuss the possibility of L(y) being norm reflexive. 


7.41 Complex L’ Spaces 


If (T, S, p) is a measure space, we can define complex L? spaces just as 
we did in the real case, except that we consider functions with complex 
‘values. The results developed in §§ 7.3, 7.4 can all be carried over to the 
complex case. In some parts of the work the complex case can be treated 
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by separation of the functions into real and imaginary parts; in some 
instances the best procedure seems to be to imitate the proofs of the real 
case, making a few necessary modifications here and there (such as 
writing sgn Z instead of sgn z in certain places). 


7.5 Measures in Locally Compact Hausdorff Spaces 


In this section we sketch the subject of measures in locally compact 
Hausdorff spaces, primarily with a view to indicating the fundamental 
connection between regular Borel measures and positive linear functionals. 
Our interest is not to develop the subject systematically, with proofs, but 
to outline the structure of what we need to know in order to obtain a 
representation theorem for continuous linear functionals on a certain kind 
of space of continuous functions. 

Throughout this section we let T denote a locally compact Hausdorff 
space. Let S be the o-ring of Borel sets in T (defined in § 7.1). A real- 
valued function x defined on Tis called Borel-measurable if it is measurable 
with respect to S in the sense defined in $7.1. It can be shown, in 
particular, that x is Borel-measurable if it is continuous and if the set 
N(x) = (t:x(t) # 0} is contained in a countable union of compact sets. 


Definition. A measure u on S is called a Borel measure if (C) < oo 
for each compact set C. The measure is called regular if for every Borel 
set E we have 


a. (E) = sup u(C) (C compact, C € E). 
b. (E) = inf (U) (E € U, U an open Borel set). 
U 


An open set may fail to be a Borel set; however, an open set is a Borel 
set if it is contained in a countable union of compact sets. 
We use the following notations: 


C: the family of compact sets in T. 

U: the family of open Borel sets in T. 

R: the family of sets such that each is contained in a countable union 
of compact sets. 


Note that R is a o-ring and that every subset of a member of R is itself 
a member of R. 

If T happens to be compact, all open sets are Borel sets, and R is the 
class of all subsets of T. 

If x is a function defined on T, the closure of the set N(x) is called 
the support of x. 
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Definition. We denote by C«(T) the class of all real-valued continuous 
functions x defined on T, such that the support of x is compact. We 
denote by P the class of those x € C«(T) such that x(t) > 0 for each t e T. 


Evidently C.(T) is a linear space. It is a normed linear space with 
norm defined by 


ixi = sup |x}. 
teT 


The finiteness of ||x|| stems from the fact that x has compact support. 
If T is compact, then C«(T) is the same as the space C(T) defined in 
Example 4, 83.11. The space C«(T) is complete if T is compact. 

We write x > y if x — y P. Thus x 2 0 and x e P mean the same 
thing. 


Definition. If x’ is a linear functional on C«(T) such that x'(x) > 0 
whenever x > 0, we say that x’ is positive. We denote by P' the class of 
such x'. 


If x € C«(T) and p is a Borel measure, then x is integrable with respect 
to u. For, if C is the support of x and M = sup |x(r)|, it is clear that 
teC 


|x(£)| < Mxc(t) But the characteristic function xc is an integrable 
simple function; hence x is integrable (see the end of $ 7.1). 
If p is a Borel measure and if we define x’ on C«(T) by 


(7.5-1) x(x) = | x dy, 


it is evident that x' € P'. The rest of this section is devoted to a 
discussion of this formula. We indicate how it is established that, if we 
confine attention to regular Borel measures, there is a one-to-one corre- 
spondence between P' and the class of regular Borel measures, with 
corresponding elements x’ and p related by (7.5-1). Our exposition is in 
outline only, with proofs omitted. For details we refer the reader to 
Halmos, 2, Chapter X. 
Let us begin with an x' € P'. For each Ce C let 


(7.5-2) A(C) = inf x'(x), 


the infimum being taken over all x € P such that x(t) > 1 on C. The fact 
that functions x of this kind do exist is shown by Theorem 2.31-B. It 
can then be shown that this function A is what is called a content. That is, 
(a) 0 < XC); (b) XC)) < XC) if C, € C2; (©) ACi U Cx) < XC) + 
(C5); (d) XC, U Co) = ACC) + ACC) if Ci A C; = 9. Theorem 2.31-A 
is used in the proof of (d). 

Now, there is a procedure by which a content induces a regular Borel 
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measure. The steps in this procedure are as follows: First define A,(U) 
for each UE U by 


(7.5-3) A,(U) = sup XC) (C compact, C € U). 
C 


Then define u*(E) for each E € R by 
(7.5-4) u*(E) = infd\,(U)  (U&U, EC U). 


The function u* turns out to be an outer measure. That is, (a) u*(E) > 0; 
(b) w*@) = 0; (© wME) < p*(P)ifE c F; (d) ut ( U 2 <> wy. 
n=1 n=1 


From the outer measure u* a measure is constructed in the standard way. 
A set Ec R is called .*-measurable (hereafter just measurable) if 


U* (4) = &*(A N E) + p(AN E?) 


for each A € R. The measurable sets form a o-ring, and on this o-ring 
p* is a measure which we denote by p. All sets of outer measure 0 are 
measurable. Every Borel set is measurable, and u is a regular Borel 
measure on the o-ring of Borel sets. This measure u, obtained by starting 
from (7.5-2) is called the regular Borel measure induced by x’. One of 
the important facts is that 

(7.5-5) HC) = XC) 

for every compact C. 

The next major step is to show that, if » is induced by x’, the formula 
(7.5-1) is valid for each x € Ca(T). Finally, it must be shown that, if we 
define x’ by (7.5-1), where p is a given regular Borel measure and if v is 
the regular Borel measure induced by x’, then v = p, For this uniqueness 
proof the regularity of both u and v is needed. 

An important feature of the correspondence between x’ and y is that, 
if y' and v also correspond and if y' — x’ e P', then p(E) < v(£) for each 
EeS. This is clear from (7.5-2), (7.5-5), and the regularity of p and v. 


7.51 Signed and Complex Borel Measures 


As in $7.5 we consider a locally compact Hausdorff space and the 
o-ring S of Borel sets in T. 


Definition. Bya signed Borel measure on S we mean a signed measure 
p. (defined in $7.2) such that |&(C)| < oo if C is compact. This is 
equivalent to requiring that u* and u- both be Borel measures. A 
complex measure such that its real and imaginary parts are signed Borel 
measures is called a complex Borel measure. 
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We shall need the concept of regularity for signed and complex Borel 
measures, One way to extend this concept would be simply to say that 
a signed Borel measure y is regular if pt and u~ are regular and that a 
complex Borel measure is regular if its real and imaginary parts are regular. 
However, we prefer to confine our attention to finite measures and to give 
the definition in a different way. 


Definition. Let p be a finite complex or signed Borel measure. 
Then p is said to be regular if, corresponding to each Borel set E and 
each e > 0, there exists a compact set C and an open Borel set U such 
that C c E c U and such that 


(7.51-1) lE) — p(F)| < « 
whenever F is a Borel set such that C c F c U. 


If u is nonnegative, this definition of regularity is equivalent to the 
definition given in $7.5; this is readily seen from the fact that u is 
monotone, so that (C) < p(F) < (U). 

The sum of finite regular real or complex Borel measures is again such 
a measure. For, if p = u; + p; and if we choose C, and U, so that 
(7.51-1) is satisfied for u, (k = 1, 2), we can define C= C,UC,, 
U = U, ^ Uy, and p will then turn out to satisfy (7.51-1) with 2« in place 
of «e. Likewise, regularity is preserved if we multiply » by a scalar. 
Using the norm defined by (7.2-5), we can form a normed linear space of 
real or complex finite regular Borel measures. This space is complete. 
The completeness will appear later as a by-product of a representation 
theorem for linear functionals (see Theorem 7.7-G). 


Theorem 7.51-A. Jf p is a finite regular signed Borel measure and 
p = pt — p is its Jordan decomposition, then p*, u-, and |p| are finite 
regular Borel measures. 


PROOF. It is enough to show that pt is regular, since u^ = (— p)*, 
and — & is regular if u is. The regularity of |u| follows, since 
|u| = w+ + p. Now let E be a Borel set, and suppose « > 0. Choose 
a compact set C and an open Borel set U such that C c E c U and such 
that |u(E) — u(F)| < e/2 if Cc Fc U. Let G be any Borel set 
contained in U— C. Let A—- EU(G— E) B=E-—G. Then 
CcAcU,CcBcUL,andso : 

|(E) — p(A)] < €/2, — |w(E) — (I < «2. 
But 
HG) = (GO E) + WG — E), 
HE) = (GO E) + p(B), 
p(A) = WE) + WG — E), 
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SO 
(7.51-2) |G) < leCE) — eB) + |u(4) — ME) < €. 
It now follows from (7.2-1) that 
pU — C) = sup WG) < «. 
GcU-C 


Now E = CU (E — C) and pt(E — C) < &*(U — C) € e, so 
p) = (E) - &E — C) > ut(E) - e 
Likewise 
p*(U) = u*(E) + u*(U — E) < p(B) + &(U — C) < p(E) + e 
These results show that «+ is regular. 


Theorem 7.51-B. Jf « is a finite regular complex Borel measure, the 
total variation |u] is a finite regular Borel measure. The real and imaginary 
parts of y. are finite regular signed Borel measures. 


PROOF. First we show that, for any Borel set E, 
(7.51-3) l&IE) < 4 sup |a(F)]. 
Let p = p, + ivy, where u, and p, have real values. Denote the Jordan 


decompositions of u, and u, in the usual way. Now, for any Borel set E, 


pa *(E) = sup j4(F) < sup ]u(£)], 
FCE FOE 

pa (CE) = sup (— p(F)} < sup |u(F)], 
FcE FOE 


with corresponding results for u?;* and u~. Thus, if Ej, ---, E, are 
pairwise disjoint Borel sets contained in £, and G = £,U---UE,, 


» H(E,)| < » pi (Ex) + 5 pa (E) + » pa*(Ey) + S p (Ex) 
kzi k-i k=l K-1 kI 


= p*(G) + py (G) + m*(G) + uz (G) 
< p, (E) + m (E) + mE) + n3 (E) € 4 sup lC). 


In view of the definition of |x] [see (7.2-4)], this proves (7.51~3). 

Now, to prove that |u| is regular, we proceed as in the proof of Theorem 
7.5]-A as far as (7.51-2), and it then follows from (7.51-3) that 
\u|(U — C) € 4e. The rest of the proof is then as before, with || in 
place of p+. 

The fact that the real and imaginary parts of u are regular is seen at 
once from the defining condition (7.51-1). 
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7.6 Vector Lattices 


In $ 7.7, in the discussion of continuous linear functionals on C.(T), 
we shall find it convenient to use notions which find their general 
expression in the context of vector lattices. Hence this section is devoted 
to a brief discussion of vector lattices. 

Let A be a partially ordered set with elements a, b, - - - (see § 1.7), and 
let the order relation be denoted by < instead of <. If a € c and 
b < c, we call c an upper bound for a and b. If furthermore c < d 
whenever d is an upper bound for a and b, we call c the least upper bound 
of a and b, and write c = sup (a, b). This element of A is unique, if it 
exists. In a similar way we define the greatest lower bound of a and b, 
and denote it by inf (a, b). If sup (a, b) and inf (a, b) exist for every 
pair a, b in A, A is called a /attice. 


Definition. By a partially ordered linear space we mean a linear 
space A which is partially ordered by a relation < in such a way that 
the two following conditions are satisfied: 


a x b implies a + c < b + c for every c. 
a < b implies aa < ob for every « > 0. 


If A is moreover a lattice we call it a vector lattice. 


For each element in a vector lattice we define 


(7.6-1) a* = sup (a, 0), a` = — inf (a, 0). 
Theorem 7.6-A. In a vector lattice A we always have 

(7.6-2) a=at—a, 

(7.6-3) inf (at, a7) = 0. 


PROOF. To prove (7.6-2) we show that a — a* = inf(a, 0). We 
know that 0 < at and a < at, by the definition of a^. Equivalently, 
then, a — a^ < a and a — at < 0. To complete the proof we suppose 
that b < a and b < 0 and show that b < a — at; it will then follow that 
a — at = inf (a, 0. Now b < a and b < 0 are equivalent to O < a — b 
anda x a — b. Hence, by the definition of a*, we have at < a — b, or 
b < a — at. This finishes the proof of (7.6-2). The representation of a 
by (7.6-2) is called the Jordan decomposition of a. 

To prove (7.6-3) we note first that O < at and 0 < a. Hence (7.6-3) 
will be proved if we show that c < a+ and c < a` together imply c < 0. 
We rewrite c < a^ and c < a` in the forms 0 < at —c, a < at — c. 
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It then follows that at < at — c, or c € 0, by the definition of a+. This 
completes the proof of Theorem 76-A. 

It is useful to know the following formulas, which are valid in any 
vector lattice: 


(7.6-4) inf (a, b) = — sup (— a, — b), 
(7.6-5) sup (a, b) + inf (a, b) = a + b, 
(7.6-6) sup (a, b) = a + sup (b — a, 0). 


We omit the proofs, which are much like the proofs of (7.6-2) and (7.6-3). 
If A is a partially ordered linear space such that sup (a, 0) exists for 
every a € A, then A is a vector lattice. For, it is then easy to show that 
sup (a, b) exists for every pair (a, b), being given by (7.6-6); and inf (a; b) 
exists, being given by (7.6-4). These remarks are useful when it comes to 
verifying that we have a vector lattice in various concrete situations. 

The space C«(T) is a vector lattice, with the partial ordering x < y 
defined to mean that x(t) < y(t) for every te T. Inthiscasez = sup (x, y) 
is the function defined by z(t) = max {x(‘), y(D). Then x'*(f) = 
max [x(¢), 0] and x-(r) = — min [x(#), 0]. 

The finite signed measures on a fixed o-ring form a vector lattice, the 
partial ordering » < v being understood to mean (E) < w(E) for every 
E in the ring. The Jordan decomposition u = pt — p^ described in 
§ 7.2 is what (7.6-2) becomes for this case. The finite regular signed 
Borel measures on the Borel sets of a locally compact Hausdorff space 
also form a vector lattice (see Theorem 7.51-A). 

In § 7.7 we shall see that the continuous linear functionals defined on 
Cx(T) also form a vector lattice. Here the partial ordering x’ < y' 
means that x'(x) < y'(x) whenever x > 0. 


7.7 Linear Functionals on C,,(T) 


In this section we use the notations of $ 7.5. Our principal aim is to 
show that we can identify the normed conjugate of the real space C«(T) 
with the Banach space of all finite regular signed Borel measures on S. 
This identification is actually, of course, a congruence of the two Banach 
spaces in question. The Banach spaces are vector lattices, and the linear 
correspondence is order preserving. 

In the course of our work we go somewhat further than a study of the 
continuous linear functionals on C«(T); we examine linear functionals 
which may not be continuous, but which have a property which we call 
relative boundedness. It turns out that these linear functionals are 
precisely those which can be expressed as the difference of two positive 
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linear functionals (as defined in § 7.5). If Tis compact, relative bounded- 
ness is the same as continuity. A relatively bounded linear functional is 
called a Radon measure by some authors; see Bourbaki, 5 


Definition. A linear functional x’ defined on C«(T) is said to be 
: relatively bounded if to each compact subset To of T there corresponds a 
nonnegative number m(To) such that 


(7.7-1) lx'G)| < mTl 
whenever x € Co(T) and the support of x is contained in To. 


It is easily seen that the relatively bounded linear functionals form a 
linear space. 


Theorem 7.7-A. A positive linear functional on C«(T) is relatively 
bounded. 


PROOF. Given a positive x’ and a compact set Ty, we choose a neighbor- 
hood U of Ty having compact closure and a function y € Ce(T) such that 
(t) = 1 on Ty, y(t) = 0 on U’, and 0 < p(t) < I for all t (Theorem 
2.31-B). If the support of x is contained in Tọ, it is clear that 
— |xliy(t) < x(t) < |lxlly(?) and, therefore, that — ixix'(y) < x'(x) < 
lixlx'(y), since x’ is positive. We can then choose m(T 9) = |x'(y)| to 
show that x' is relatively bounded. 

Our next main objective is to show that every relatively bounded linear 
functional is the difference of two positive linear functionals. For this 
we need some preliminary results. 


Lemma 7.7-B. Jf f is a real-valued function on C.(T) such that 
f(x + y) =f) + f(y) for every x and y and if f(x) 2 0 whenever x > 0, 
then f(ax) = af(x) for each real a. 


PROOF. This theorem is actually valid with any vector lattice in place 
of C«(T), as the proof will show. From /(0) + /(0) = (0) follows 
f() = 0. Then f(x)  f(— x) = f(0) = 0, sof(— x) = — f(x). Hence 
it suffices to prove f(«x) = af(x) fora > 0. It also suffices to show this 
= x 2 0, since every x can be written as x = xt — x- with xt > 0, 

20. Now it is easy to deduce that f(ax) = af(x) if « is positive and 
teal we omit the details. It is for the case of irrational « that we 
need to know that f(x) > O if x > 0. Let (o,) and {8,} be sequences of 
bn E to « such that «, < œ < B, Then, if 

20, ax < ax < pyx and «,f(x) = f(e,x) < flex) < ABX) = Bf. 
quud n — ©, we obtain af(x) € f(ax) € «f(x). This completes the 
proof. 
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Lemma 7.7-C. If f is a real-valued function which is defined, with 
nonnegative values, for each x € Ca(T) such that x z 0, and if f(x + y) = 
F(x) + f(y) for each x and y of this kind, there is a unique linear functional 
F defined on C«(T) such that F(x) = f(x) if x > 0. 


PROOF. This result also holds for any vector lattice, not merely on 
C«(T). Each x can be written in the form x = x, — x; with x, 2 0 
and x; > 0. If we have another such representation x = y, — y», then 
xX; + y2 = X, + yp Whence it easily follows that f(x) — f(x.) = 
f(x) — f(y. Consequently, if we define F(x) = f(xi) — f(x), the 
value of F(x) depends only on x and not on the way in which x is 
decomposed. (We note, incidentally, that this is the only value that 
F(x) could have if it is to be linear and an extension of f. Hence the 
uniqueness part of the assertion in the theorem.) It is easily verified that 
F(x + y) = F(x) + F(y), and F(ax) = «F(x) follows by Lemma 7.7-B. 
Thus the proof is finished. 


Theorem 7.7-D. The relatively bounded linear functionals on C«(T) 
form a vector lattice. If x' is such a functional, then the Jordan 
decomposition of x' is 


(7.7-2) x'-—(x)y-Qqy, 
where (x')* and (x')- are defined as follows: 
(7.7-3) oy) = sup x'(x), 
(7.7-4) (xy) = - inf x'(x), 


where y > 0 and P, is the set of all x € C«(T) such that 0 < x < y. 


PROOF. Observe that |x| < ||yl| if x € P,. Also, if To is the support of 
y, the support of x is contained in Ty. Hence, by (7.7-1), we have 


(7.7-5) Ix'G9] < mIGnyliyil 
if xeP,. At this stage we define f(y) = sup x'(x) if y > 0. Clearly 
xeP, 


JV) is finite, by (7.7-5); and f(y) > 0, for OE P,. If 0 < x, < y, and 
0 x x. € y,, we have 0 € x, + x; € y, + y2 and therefore x'(xj) + 


x(x) = x'(xi + x; <S f(y1 + y2). It follows that f(yj) + f(y.) S 
f(y, + y2) To prove the reverse of this inequality, suppose that x, 
yi, and y; are given, with x € P,,,.. We define 


xi(f) = min (x(t), v1} 
x2(t) = max (0, x(r) — yi}. 
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Then x, and x; are in Ca(T) and x = x, + x}. It is evident that 
0 < xı xy, Itis also true that O < x; < y2- For, if x(t) < y,(4), we 
have x4(f) = 0 < y(t), and if x(t) > y,(t), we have x(t) = x(t) — y,() < 
yilt) + yot) — yi) = yx). But then x'() = x(x) + x G2) < f) 
+ f2), and so f(y; + y2) < fY) + f. It is now clear that f 
satisfies the conditions of Lemma 7.7-C and hence that it can be extended 
in a unique way to give a positive linear functional on C«(T). We 
denote this extension by (x’)+; thus (x’)+ is determined by (7.7-3). 

It is clear that C«(T) is a partially ordered linear space, and it is seen 
directly from (7.7-3) that (x’)+ is sup (x', 0). As was remarked in § 7.6, 
the existence of sup (x’,0) for each x’ insures that we have a vector 
lattice. As for (x’)-, we can either define (x')- in terms of x’ and (x’)* 
by (7.7-2) and then prove (7.7-4), or we can define (x’)~ by (7.7-4), verify 
that (x’)- is in fact — inf (x’,0) in the lattice sense, and then obtain 
(7.7-2) as a special case of (7.6-2). -We leave details to the reader. 

We define a positive linear functional |x’| by the formula 


(7.7-6) |x'| = (xt + (x). 


We must be careful to distinguish |x'|(x) from |x’(x)]. Of course we have 
(x)* = |x'| = x’ if x' 2 0. It may be shown without great difficulty 
(see problem 2) that 


(7.7-7) |x'|Q») = sup x’(x) 
IxlePy 
if y > 0. Here |x| denotes the function whose values are |x(1)]. 
As a consequence of (7.7—7) we see that 
(7.7-8) [x'69] < |x"|(|x))- 
For, x'(x) < |x’|(|x|); on combining this with what is obtained when x is 
replaced by — x, we obtain (7.7-8). 


Definition. If x’ is any relatively bounded linear functional on Cæ(T), 
we define 


(7.7-9) lix'll = sup [x' G9]. 
It may of course happen that |jx’|| = oo (though not if T is compact). 
The condition ||x’|| < oo is satisfied if and only if x’ is continuous on 


Co(T) as a normed linear space. The triangular inequality ||x’ + y'|| < 
xli + Ily] is valid, with the usual conventions about oo. 


Theorem 7.7-E. The following relations hold: 
(7.7-10) lx’ = sup [x'|(), 
O<y<l 
(7.7-11) xt tl = ell. 
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If x' 2 0 and y' > 0, then 


(77-12) lx" + »'ll = xl] + Ult 


PROOF. We remark that the function with value 1 at all points of T 
does not belong to C«(T) unless T is compact. Nevertheless, it is 
convenient to write y < 1 if y(t) < 1 for all t. Suppose that O < y < 1 
and |x| < y. Then ||x|| € 1. By combining (7.7-7) and (7.7-9) we see 
that |x’|(y) < ||x’||. Thus Sup |*'10) < lx'|. On the other hand, 

y 


xi] € 1 implies |x| < 1; hence (7.7-8) implies 
Ix'G9| < sup |x|) 
O<y<l 
if |x|] < 1, and from this we infer that 
ixi < sup |x |O). 
O<y<i 


This proves (7.7-10). The truth of (7.7-11) follows at once from (7.7-10) 
and the fact that |y’| = y' if y’ = |x’. 

To prove (7.7-12) it suffices to prove that |x + y'i 2 lxi + lly’ll 
under the given conditions, for the reverse inequality is always true. If 
Oxx«landOxyxl,let z(t) = max {x(t), (D). ThenO xz « l, 
x<z, y<z. Since x’ and y' are positive, we have x'(x) < x'(z), 
y(y) < y'(z), and therefore 


x'(x) + yy) < G' + yz) < lx + yl. 


Since x’ = |x'| and y'= |y', we now infer from (7.7-10) that 
lIx’i] + yil < lx + y'l. Thus (7.7-12) is proved. 

Now suppose that x’ is a relatively bounded linear functional on Ce(T). 
By the results described in $ 7.5 we know that to the positive linear 
functional (x^)* there corresponds a unique regular Borel measure, which 
we denote by p+, such that 


(7.7-13) | x dus = (x) 


for each x € C«(T). Likewise, to (x’)- corresponds a unique regular 
Borel measure »— and a formula corresponding to (7.7-13). Hence x’ 
has the representation 


(7.7-14) x(x) = | x dps — Í xdu., xeCw«(T). 
The representation of |x'| is 


(7.7-15) |x'[(x) = | x dy, 
where v = u+ + p—. 
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It should be noted that we do not at this juncture define a signed 
measure p = u+ — p, for we have no assurance that the situation 
p4(E) = u-(E) = + œ cannot arise, and thus the unambiguous definition 
of u may be impossible. Presently we shall see that in the case when x’ 
is continuous, u+ — p- is indeed the Jordan decomposition of a finite 
signed measure y. 

We have the following theorem. 


Theorem 7.7-F. Jf x’ is any relatively bounded linear functional on 
Ca(T) and if v is the regular Borel measure corresponding to |x'|, then 


(7.7-16) \|x’|| = sup (E). 
EeS 


PROOF. Because of (7.7-11) it suffices to give the proof on the 
assumption that x’ 2 0. In this case v = wi and p- — 0. Consider 
any y € C«(T) with 0 < y < 1, and let C be the support of y. There 
exists a neighborhood U of C with compact closure (so that U is a Borel 
set) and a function x € C«(T) such that 0 < x < 1, x( = 1 on C and 
x(t) = OonT— U. Then y < x and x'(y) < x(x). Also 


x(x) = [xa < »(U). 


Thus, if M denotes the supremum on the right in (7.7-16), we have 
x'(y) < M, whence ||x’|| < M, by (7.7-10). On the other hand, if C is 
any compact set, there exists x € Ce(T) such that x() = 1 on C and 
Osxx«xl. Then, by (7.5-2) and (7.5-5) we see that (C) < x'(x); also, 
of course, x'(x) < ||x'|. By the regularity of v it then follows that 
WE) < |x'|| for every EES. This completes the proof of (7.7-16). 

If x’ is not merely relatively bounded, but continuous, (x^)* and (x’)- 
are continuous also. This is clear from (7.7-12) as applied to (7.7-6), 
in view of (7.7-11). Hence the continuous linear functionals on C«(T) 
form a vector lattice. 

We come now to the representation of the normed conjugate of C..(T). 


Theorem 7.7-G. The normed conjugate of C«(T) is congruent as a 
Banach space to the Banach space of all finite regular signed Borel measures 
on S. The correspondence between a continuous linear functional x' and 
a finite regular signed Borel measure y. is established by the formula 


(7.7-17) x(x) = J xdp  xeC«(T). 


These Banach spaces are also vector lattices, and the correspondence set up 
by (7.7-17) is order-preserving, so that it is a lattice isomorphism. 
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PROOF. Starting with x’, we obtain the representation (7.7-14). The 
norm of x’ is given by (7.7-16), and since v = u+ + p, it is clear from this 
that the values of p+ and u- are always finite, because ||x'| < oo. Hence 
we can define p = u+ — p-, and pis a finite regular signed Borel measure. 
At this stage we do not yet know that u+ = wt and p- = p~. It is notat 
once evident that the mapping x’ — u is linear, but we shall show that 
itis. From (7.7-3) it is readily apparent that (x' + y)* < (x^)* + (y)*. 
Let us write 

z = (x) Qn -Q yy. 
so thatz' 2 0. From (7.7-2) we see that 

Pa +O = A td 
also. Now let pi, v+, w+ denote the regular Borel measures associated 
with (x^)*, (y^)*, (x' + y)*, respectively, and similarly for p-, (x')", and 
so on. The measure associated with z' can be expressed either as 
p+ ove — w+ Or as p- + v- — w. (The fact that u+ + v+ — w+ has 
nonnegative values follows from the fact that the correspondence between 


positive linear functionals and regular measures is order-preserving; see 
the very end of § 7.5). But then 


w+ — w- = (p+ — p-) + (v+ — v-), 


and this shows that the mapping x’ — u is additive. Next, it is evident 
from (7.7-3) and (7.7-4) that (a«x')* = e(x)* and (ex) = e(x)- if 
a 20, while («x')* = — a(x’) and (ex)- = — a(x’) if « «0. In 
either case we see that if x’ — u then ax' — ep. Thus the mapping is 
linear. It is clear from (7.7-14) that » = 0 implies x’ = 0. Conse- 
quently, it will be established that we have a one-to-one mapping onto 
the space of all finite regular signed Borel measures if we show that every 
p is the image of some x’. 

We therefore let u be given, and let its Jordan decomposition be 
pt — g^. We define x’ by (7.7-17) [see (7.2-6)). If C is the support of x, 


x| < fIxl dle] < Ixl elc) < Il lel 


[where || is defined by (7.2-5)]. This shows that x’ is continuous. 
Applying (7.7-14) to x', we have 


E du. — E du- — fx dut — fx du^, 
and hence also 


[sdas + 92 = [x au* + wd 
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for each x € C«(T). But then, by the uniqueness feature of the 
correspondence between positive linear functionals and regular Borel 
measures (described in § 7.5), we infer that p+ + p^ = pt + p-, or 
u = pe — p- Hence p is the image of x’ under the mapping described 
at the outset of the proof. 

The fact that the mapping is order-preserving follows from the fact that 
it is one-to-one plus the fact that every positive functional is representable 
with the aid of a nonnegative measure. The mapping then preserves least 
upper bounds and greatest lower bounds. From this it follows that 
u+ = ut, for u+ is the image of (x')* = sup (x', 0), while u* = sup (p, 0). 
Likewise p- = po. 

Finally, the mapping is norm-preserving. This follows from (7.7-16) 
and (7.2-5), for we now know that u+ + p- = |u|. Since the normed 
conjugate of C.(T) is complete, it follows that the space of finite regular 
signed Borel measures is also complete. 


PROBLEMS 


l. Carry out at least one of the suggestions for dealing with (x’)~ as indicated 
at the end of the proof of Theorem 7.7-D. 


2. Prove (7.7-7). Suggestions: If 0 < |x| < y, note that 0 < xt < y and 
Oxx- xy Then x(x) < |x'|(y) follows from (7.7-3) and (7.7-4). On the 
other hand, if € > 0, choose x, and x; in P, so that x'(xi) > (x^)*(»y) — (e/2) 
and x/(x;) < — (x)"(») + (ej2. Then consider x = x, — x». 


3. Prove that [ix'|| = I(x] + |’) |}. 
4. Prove that |x'|| < !y/|| if O < x’ < y. Use (7.7-12). 


5. If T is compact and x’ is a continuous linear functional on C,(T) 
[=C(T)], show that |x| = |x’|(1), where 1 denotes the function of all whose 
values are unity. 


6. If (pi, #2) and (vi, v2) are two pairs of regular Borel measures on S, we 
define these pairs to be equivalent if uj(E) + v2(E) = pE) + v,(E) for every 
EeéS. Show that 


ELT ELT and [xan - f xd 


define the same relatively bounded linear functional on C4(7) if and only if 
(ui, #2) and (v1, v2) are equivalent. Show that there is a one-to-one correspond- 
ence between the set of all relatively bounded linear functionals on C,,(T) and 
the set of all equivalence classes of pairs of regular Borel measures. 


7. For the purpose of extending some of the results of § 7.7 to the complex 
case, let C4(T) denote the set of complex-valued continuous functions on T, 
each with compact support. Denote the corresponding space of real functions 
by RC4(T). If z’ is a relatively bounded complex linear functional on C,,(7), 
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if we write z' = x’ + iy’, where x’ and y' have real values, and if we write 
elements of C,,(T) in the form z = x + iy with x and y € RC,,(T), show that 


z'(z) = x(x) — y'O) + i’) + ix’). 
Show that z'(z) is representable in terms of eight real integrals involving four 
regular Borel measures. Show also that 
sup |z'(z)| = sup |x’) — y»). 
lizil« 1 zi 1 


Then prove that ||z’||, defined by the foregoing supremum, which may be infinite, 
satisfies the inequalities 


CIx'll? + IDE < z^ « ux'll + till. 
Both extremes are attainable. 


8. Continuing along the lines begun in (7), show that the normed conjugate 
of C4(T), in the complex case, is congruent to the space of finite regular complex 
Borel measures on S. The principal difficulty is in showing that the one-to-one 
correspondence is norm preserving. It suffices to show that, if z’ and p cor- 


respond by the formula z’(z) = J z du, then ||z’|| > llull, for the reverse inequality 


is evident. We outline the argument. With e > 0 given, choose a Borel set 
E so that |u|(E) > lll! — (e/3). Then choose pairwise disjoint Borel sets 
E,,:-:, Ep such that E, C E and 


> Ed > eB) — (e/3). 
k=1 
Now, if ||z|| < 1 


liz^li > 


f z dp >> |pCE)| — 


f zdu- > mea 


> liall — $e— 


EE $ MEDI |. 
k=1 


Hence it suffices to be able to choose z so that lzjj < 1 and 


fede ~ > Ed! 
k=1 


For each k let C, and U, be, respectively, compact and open Borel sets such 
that C, € E, € U, and such that |u(E;) — p(F,)| < (e/27n) if Fp is a Borel set 
for which C, cC F, € U,. One can then show, just as in the proof of the 
regularity of |u| in Theorem 7.51-B, that [u|(U, — Cp) < (8/27n). It also 
follows that 


< e3. 


> Iul - > 159) |< 2 lC) — w(E,)| < €/27. 
k=1 


For each i and j with i z j(i, j = 1, ---, n) there exist disjoint neighborhoods 
V;; and Vj; of C; and C; respectively, with compact closures. Let V, be the 
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intersection of Up and all the V,; for which j £ k. Then C, C V,c Up, 

V, is open with compact closure, and V, V; = 0 if k #1. Choose x, € 

RC,(T) so that 0 < x, <1, x,() ^ 1 on C, and x,(r) = 0 on T — Vp. 
n 


Let a, = sgn (Ck) and z = 2 eQX,. This element of C,,(T) will do what is 


required for the completion of the proof. 


7.8 Finitely Additive Set Functions 


In the proof of Theorem 7.4-A we used the fact that p < oo in proving 
that the set function v is countably additive; the fact that v is finitely 
additive remains true even in the case p = œ. Finitely additive set 
functions turn out to be of interest in connection with the study of linear 
functionals on spaces of bounded or essentially bounded functions. 


Definition. Let T be a nonempty set, R a ring of subsets of T, and 
p a finitely additive set function on R with real or complex values. If 
the values of u on R are bounded, we call u a charge on R. If uisa 
charge and T € R, we call (T, R, p) a totally charged space. 

This terminology concerning charges is due to Rosenbloom, 1. 

Being finitely additive means that (E U F) = W(E) + u(F) if E and 
F are disjoint members of R. Of course R contains the empty set f), 
and hence (ð) = 0. 

A real-valued charge » has a Jordan decomposition u = pt — u”, just 
like a signed measure (§ 7.2). With a charge p we associate the total 
variation |u|, given by (7.2-4), just as with a signed or complex measure; 
|u| is a nonnegative charge. We define the norm [|u|| of a charge p just 
as in (7.2-5). The charges on R form a Banach space. If the space is 
totally charged, |||] = ]ul(T). 

Charges can be used to represent the normed conjugate of the space 
B(T) (defined in Example 3, § 3.11). First we must define a type of 
integral with respect toa charge. This integral is to some extent analogous 
to the classical Riemann-Stieltjes integral and is defined with the aid of 
the notion of Moore-Smith convergence. For terminology about 
directed sets, nets, and Moore-Smith convergence see Kelley, 1, Chapter 2. 

Suppose that (T, R, u) is a totally charged space. By a partition of T 
we mean a finite collection Ej, ---, E, of pairwise disjoint nonempty 
members of R such that T= ELU -U Ep If, = (Ej, +++, En) and 
75 = (Fi, +++, Fna) are partitions, we define 7, < 72 to mean that each F; 
is a subset of some E, (r, is a “refinement” of mı). This gives a partial 
ordering of partitions, and every pair of partitions has an upper bound, 
e.g., the "superposition" of the two partitions. Hence partitions form a 
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directed set. Now suppose that x is a scalar-valued function defined on 


T. If m = (Ey, ^-^, Ej) is a partition, choose points 7, € E, and write 
(7.8-1) flrs ty is t) = > xe D. 


k=1 


The (many-valued) function fis a net on the directed set of partitions. If 
the net converges to a limit 7, this limit is called the S-integral of x with 
respect to u: 


r= S [x d. 


This means, of course, that for every « > 0 there is some partition r, 
such that f(r; ti,- -, ta) differs from / by less than e if m, < ~. 

The function x is called measurable if x-!(M) € R for each semi-open 
interval M = (t:« < t < B). This is for the real case. In the complex 
case we use semi-open rectangles. It can then be proved that when 
(T, R, p) is a totally charged space and x is a bounded measurable function 
on T, then x is S-integrable. The argument depends on a Cauchy 
condition for the convergence of nets. We give the argument for the 
complex case. 

Choose a semi-open rectangle M whose interior contains all the values 
of x. Suppose « > 0, and partition M into disjoint semi-open rectangles 
Mi, ---, Mm all of diagonal less than e. Let F, = x !(M,), and let 


Ei, ++, E, be the distinct nonempty sets among Fi, ---, F,, Then 
7 = (Ey, ^, Ej) is a partition of T. Suppose now that 7, = (Gj, =>) 
and v, = (Hj, -- -) are partitions of T such that m < mı anda < mp, and 


choose points s; € G;, tj € Hj. We can write 


MG) = > MGA H), >, xou) = > xG: N H), 


j ij 


and so we see that 


(1.8-2) > xG) — > xu) = > (6) — xul; N H). 
i j LJ 

We need only consider those terms for which (G; O Hj) # 0, and for 

such terms G; and H; are both contained in the same Ep, which means that 

x(s;) and x(tj) are contained in the same M,, and hence that |x(s;) — x(¢;)| 

< e. Consequently, the absolute value of the expression in (7.8-2) does 

not exceed 


«> |G, HDI < ell). 
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This shows that the net satisfies a Cauchy condition and is therefore 
convergent. 
The S-integral evidently satisfies the inequality 


(1.8-3) |S fx de | < sup [x01 |ul(7). 


Now consider the Banach space B(T), where T is any nonempty set. 
Let R be the ring of all subsets of T. Then any member of B(T) is 
S-integrable with respect to any charge on R. 


Theorem 7.8-A. With T and R as just described, the normed conjugate 
of B(T) is congruent to the space of all charges on R, the correspondence 
between a continuous linear functional x' and its associated charge p being 
indicated by the two formulas 


(7.8-4) x(x) 2$ | xda,  xeB(T) 
(7.8-5) (E) = x'(xg), EeR, 


where xg is the characteristic function of E. 


PROOF. Each charge u defines an x’ € {B(T)}’ by formula (7.8-4). 
From (7.8-3) we see that |x'| < |ju/|. Formula (7.8-5) clearly holds if E 
is@or T. For any other E it suffices to observe that, if 79 is any partition 
of T and 7 = (£i, ---, E,) is the superposition of vo and the partition 
(E, T — E), the expression in (7.8-1) is equal to (E). From (7.8-5) we 
see that x’ = 0 implies u = 0. 

On the other hand, if we start with x’ and define p by (7.8-5), it is easy 
to see that » is a charge. We wish to show that (7.8-4) holds. Ife > 0 
and x € B(T), choose M, M,,---, Mm and E,,---, E, as in the earlier 
proof of integrability of a bounded measurable function. Choose any 
tk € E, and form the sum (7.8-1). Since (E) = x'(xg), we see that 


> xau) = x (> xt)». 
k k 

where y, is the characteristic function of E,. On the other hand, if 
t€ Ej 


= [x(t) — x(tj)]. 


x) — > xt)» 0) 


k 


so that 
(7.8-6) ix — 2x(t)y«l < € 
and therefore 


< elx'|. 


x(x) — > xu) 


k 
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This inequality evidently remains valid for any sums based on partitions 

obtained by further subdivision of the E,’s and so (7.8—4) is true. 
Finally, to show that jail < ||x’|| in the context of the foregoing para- 

graph, suppose e > 0 and choose a partition (Ej, ---, E) of T such that 


> IMEDI > lid — e; 
k=1 


this is possible, by the definition of |lu||. Then define x by setting 
x(t) = sgn n(E,) on E,. Then [xj < 1 and 


x(a) = Sfx da = > «gl. 
k 


Consequently ||x’|| > ||J| — «. Thus ||x’|| > llall. This establishes every- 
thing necessary for the proof of Theorem 7.8-A. 


7.9 Lebesgue Integrals with Respect to a Charge 


Let T be any nonempty set, and let S be a o-ring of subsets of T such 
that Te S. - Let N be a nonempty proper subclass of § which is closed 
under the formation of countable unions and which has the property 
that any subset of a member of N is again a member of N. Evidently N 
is closed under the formation of differences and intersections and contains 
the empty set 0. One possibility is that N consists solely of the set 9. 
However, the situation we have in mind as a model is that in which S is 
the class of Lebesgue measurable sets in Euclidean space and N is the class 
of sets of measure 0. 

If x is a real-valued function on T which is measurable with respect to 
S, we say that x is N-bounded if (1:|x(?)| > a} € N for some a > 0. The 
smallest « for which this is true is denoted by ||x|| (the existence of this 
smallest « requires the countable union closure property of N). If x and 
y are N-bounded, measurable and if lx — y|| = 0, we call them 
N-equivalent. Just as in the case of L®, we construct a Banach space 
whose elements are equivalence classes of such functions. We permit 
ourselves the abuse of language whereby we identify x and the equivalence 
class to which it belongs, and we denote the Banach space here described 
by Bn(T). If N contains only the set Ø and’ S is the o-ring of all subsets 
of T, Bn(T) is just B(T), as previously defined. If u is a measure on S 
such that the sets of zero measure form a class N with the required 
properties, BN(T) coincides with L*(u), as previously defined [problem 1, 
§ 7.3]. 
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Now suppose that » is a charge on S such that (E) = 0 if E € N, and 
suppose x € By(T). We can define an integral of x with respect to p by 
the classical procedure of Lebesgue. Write a = — lxi, 8 = ilx|j, assuming 
that |x| > 0. Suppose « = ag < a < -> < «, = Band let 


Eg = {tia = x(t}, E, = (t: ., < x(t) € o4), kK=1,--yn. 


If £j = ap and if £j, - -., é, are chosen so that o , S Ék € o4, the sums 


> [27020 
k=0 


converge to a limit as max |o, — a,_;| — 0, the limit being independent 
k 


of how the points é, ---, £, are chosen within the specified subintervals. 
This limit is by definition the L-integral of x with respect to u; we denote 
it by 


L{x du. 


The fact that the integral exists can be proved much as in the classical 
Lebesgue case, and we omit details. 

The fact that we assumed (E) = 0 if E e N shows that the value of the 
integral depends only on the equivalence class represented by the particular 
N-bounded function, not on the function itself. The definition of the 
L-integral does not require the introduction of the class N, provided we 
assume that x is bounded and measurable. Nor is it necessary to have S 
a o-ring; merely a ring is enough. However, when we introduce N, we 
assume that S is a o-ring. 

We can also deal with complex-valued functions, either directly or by 
separating into real and imaginary parts. 

It follows from the form of the sums defining the integral that 


|L fx du| < 1l lel. 


It may be proved much as in the classical Lebesgue theory that the integral 
is a linear function of x. Linearity in p is evident, but linearity in x is 
not as evident here as with the S-integral. Because of the linearity in u 
it is enough, in proving the linearity in x, to treat the case in which p has 
nonnegative values, for the general case can be reduced to this by the 
Jordan decomposition of p. We omit the details. See, for example, 
Titchmarsh, 1, or Rosenbloom, 1. 
If x is measurable and bounded, it is easy to prove that 


(7.9-1) L[xdu- S [x4 
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For, if we use the simple function 


Yes » X(t VK 


k 


related to x as in the construction leading up to (7.8-6), we see that 


Lf y du = > xWulEd, 
k 


|L] xda- L| y du | =| Lf œ ~ ») dul < Ix — yi lel < ell. 


|S] x du - L y du] < «lul, 
and (7.9-1) follows from these results. 


Theorem 7.9-A. The normed conjugate of BN(T) and the subspace of 
the space of all charges, consisting of those charges p such that u(E) = 0 
if E € N, are congruent under the correspondence indicated by the formula 


x(xX) -L | x dp. 


The argument is much the same as in the proof of Theorem 7.8-A. 
Note that, when p is obtained from x’ by the formula p(E) = x'(xg), it 
follows that (£) = 0 if EEN, for |xg|| = 0 in that case. 
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